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FOREWORD 


I 

This  report  presents  results  of  a survey  of  the  behavioral  science 
literature  dealing  with  the  subject  of  Long-ti  rm  retention  of  flight  skills. 
The  effort  was  performed  for  the  Office  of  the  Assistant  Chief  of  Staff, 
Studies  and  Analysis,  Hq.,  United  States  Air  Force,  in  support  of  their 
studies  of  pilot  proficiency  and  management  of  the  rated  force  (SABER 
WINGS  IT).  The  literature  survey  results  are  presented  here  in  an  inter- 
pretive commentary  which  relates  the  literature  to  areas  of  concern  to  the 
1 Air  Force.  An  annotated  bibliography  of  the  literature  is  presented  in 

a companion  report,  HumRRO  FR-ED(P) -76-36. 

Technical  monitorship  for  this  effort  was  provided  by  Dr.  Robert  N. 
Schwartz  and  Dr.  Thomas  C.  Donohue  of  the  Analysis  and  Evaluation  Group, 
ACS/Studies  and  Analysis,  Hq.,  USAF.  Their  assistance  is  gratefully  ack- 
nowledged, ns  is  that  of  numerous  itscarch  colleagues  in  the  US  and  in 
Europe.  In  addition,  civilian  and  military  flignt  training  and  management 
agencies  have  provided  inputs,  and  a wide  variety  of  library  resources  have 
provided  assistance.  Particular  thanks  are  due  the  USAF  Atr  University 
Library,  Maxwell  AFB,  AL  and  many  of  its  staff  who  provided  most  valuable, 
assistance.  Dr.  Paul  V..  Caro,  HumRRO,  has  provided  technical  input  through- 
out the  effort. 

This  project  was  performed  under  AFOSR  Contract  No.  F44620-76-C-010G . 


I.  BACKGROUND  AND  PROBLEM 


INTRODUCTION 

Management  of  its  rated  pilot  manpower  resource  is  a major  concern 
of  the  US  Air  Force  CUSAF) • Not  only  does  the  pilot  resource  represent 
a sizable  fiscal  investment  in  terms  of  the  costs  of  initial  training 
of  pilots  to  operational  proficiency  levels  and  the  further  training  in- 
vestment required  to  maintain  tnese  skills,  the  skills  represented  in  the 
pilot  resource  must  be  sufficient  to  meet  current  and  potential  operational 
requirements.  This  readiness  requirement  is  the  major  concern  in  Air  Force 
manpower  management. 

A principal  focal  point  in  pilot  resource  management  relates  to  pro- 
grams to  maintain  or  retrain  pilot  skills  once  they  have  been  acquired.  In 
examining  questions  concerning  pile  t manpower  management  policies,  the 
Office  of  the  Assistant  Chief  of  Staff,  Studies  and  Analysis,  Hq . , USAF, 
has  identified  long-term  retention  of  flying  skills  as  an  area  of  prime 
importance  to  the  formulation  of  effective  pilot  resource  management  policies. 
Accordingly,  it  was  decided  that  a starting  point  for  USAF  investigation 
of  this  subject  should  be  a review  of  the  literature  on  long-term  retention 
of  flying  skills,  particularly  the  behavioral  science  literature.  This 
report  presents  major  points  of  that  literature  end  relates  them  to  USAF 
concern  with  reference  to  long-term  retention  of  piloting  skills.  An 

annotated  bibliography  resulting  from  the  literature  review  is  presented 
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in  a companion  report.- 

- Prophet,  W.W.  Long-Term  Retention  of  Flying  Skills:  An  Annotated 

Bibliography.  HumRRO  FR-ED(P)-76-36,  Hjman  Resources  Research  Organization, 
Alexandria,  VA,  October,  1976. 
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BACKGROUND 


The  United  States  Air  Force,  perhaps  to  a degree  greater  than  ever 
before  in  its  history,  finds  itself  faced  with  an  increasingly  difficult 
problem  of  maintaining  combat  readiness  in  a time  of  mounting  concern  over 
resource  availability.  The  scope  of  possible  combat  contingencies  facing 
the  USAF  is  increasingly  broad,  and  the  equipment  to  meet  those  contingen- 
cies, while  of  significantly  greater  operational  capability  than  that  of 
the  past,  has  Become  significantly  more  expensive  to  procure,  operate,  and 
maintain.  Obviously,  availability  of  fiscal  resources  is  a matter  of  major 
oncerr,  to  the  Department  of  Defense  (DoD) , for  defense  must  compete  with 
other  national  programs  for  federal  funding  priority.  Similarly,  within 
DoD,  USAF  requirements  must  compete  with  others  for  available  funds. 

Important  though  these  fiscal  concerns  are,  in  1973  a new  dimension 
was  added  that  may  ultimately  be  of  more  concern  than  the  availability  of 
fiscal  resources.  The  reference  is  to  the  oil  embargo  and  the  availability 
of  fuel  resources.  This  occurrence  brought  home  most  forcefully  the  poten- 
tially severe  limitations  on  operations  of  the  military  services  and,  in 
fact,  on  the  entire  U.S.  society  and  economy,  that  result  from  our  major 
dependence  on  oil  as  the  basic  fuel,  particularly  foreign  oil.  While  the 
embargo  and  its  aftermath  have  brought  staggering  increases  in  the  cost  of 
fuel,  more  important  is  the  fact  that  for  the  first  time  the  USAF  and  the 
other  services  are  faced  with  a possibly  severe  restriction  on  flying  ac- 
tivities that  cannot  be  wholly  remedied  by  more  moaey  or  more  efficient  fuel 
logistics.  It  is  a time  for  careful  examination  of  resources  and  their 
management . 

This  situation  has  consequences  that  affect  practically  all  aspects  of 
DoD  programs,  but  a major  area  of  USAF  concern  is  the  cost  attendant  to  its 
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flying  hour  propram  and  how  to  achieve  maximum  cost  effectiveness  for  that 
program.  The  flving  hour  program,  which  supports  both  USAK  flight  oper- 
ations and  training,  represents  a major  budget  item  and,  thus,  is  a prime 
object  for  management  concern  and  attention,  both  by  DoD  and  the  Congress. 

Some  idea  of  the  concern  over  this  management  problem  can  be  gained 

1/ 

from  a recent  report  by  the  General  Accounting  Office  (GAO)  on  the  flying 
hour  programs  of  the  military  services.  This  "Report  to  the  Congress" 
states  quite  succinctly  the  ccsts,  the  importance,  and  some  of  the  problems 
of  service  flying-hour  programs.  The  following  quotes  are  illustrative: 

"The  military  services  flew  about  6. A million  hours  in 
fiscal  year  1975  at  a cost  of  about  $2.7  billion.  A large 
part  of  this  flying  was  for  transporting  personnel  and  cargo, 
for  surveillance,  and  for  similar  operational-type  flying. 

But  most  of  this  flying  was  for  training  to  develop  and 
maintain  pilot-flying  proficiency  as  an  element  of  military 
readiness . " (p  . i ) 

"The  military  services'  flying-hour  programs  are  a 
r.iul  tibi  llion-dol  iar  operation  and  a key  ingredient  for  main- 
taining a combat-ready  defense  posture.  Ihe  cost  of  increas- 
ing or  decreasing  flying  is  fairly  easy  to  measure;  the  impact 
on  training  and  readiness  is  net.  Although  it  is  generally 
recognized  that  periodic  flying  enhances  training  and  readi- 
ness, it  is  difficult  to  establish  how  much  is  enough  to  achieve 
desired  levels  of  proficiency.  Varying  tvpc-s  of  aircraft  and 
unit  missions,  the  experience  and  previous  training  of  the 
pilots  and  crews,  and  locations  influence  the  amount  of  flying 
and  its  relationship  to  training  and  readiness. 

Tn  recent  years  fuel  has  become  scarce  and  expensive. 

Even  though  the  military  services  have  reduced  the  number 
of  hours  flown,  costs  have  increased.  The  need  to  maintain 
defined  levels  of  readiness  still  remains  and  therefore, 
makes  ft  imperative  that  maximum  benefits  be  obtained  from 
available  flying  hours.  Effective  development  anti  manage- 
ment of  t ho  flying-hour  programs  thus  becomes  critical,  if 
training  and  readiness  objectives  ,ire  to  be  met."  (p.3) 


— Comptroller  General  of  the  United  States.  Flying  Hour  Programs  of 
the  Military  Services:  Opportunities  for  Improved  Management.  LCD-75- 

451,  United  States  General  Accounting  Office,  Washington,  DC,  June  18, 
1976. 
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As  suggested,  there  are  many  aspects  related  to  the  management  of 
the  USAF  flying-hour  program,  but  it  is  those  aspects  related  to  training 
that  are  of  concern  here.  Training  is  for  the  purpose  of  producing  a 
force  with  the  skills  required  to  carry  out  USAF  combat  and  non-combat 
operational  requirements.  While  it  is  not  necessary  to  review  all  aspects 
of  USAF  flight  training  in  detail  here,  an  overview  of  such  training,  as  it 
relates  to  the  current  concern  with  long-term  flight  skill  retention,  is 
appropriate. 

USAF  TRAINING  AND  SKILL  RETENTION 

The  process  of  training  a combat-effective  USAF  pilot  is  a lengthy  one. 
In  order  to  reach  the  proficiency  levels  required  for  combat  operations,  the 
pilot  must  complete  Undergraduate  Pilot  Training  (UPT)  and  training  in  an 
operational  aircraft  at  one  of  the  Combat  Crew  Training  Schools  (CCTS). 
Subsequent  to  completing  CCTS,  the  normal  career  pattern  for  the  young  USAF 
pilot  would  be  assignment  to  a major  command  operational  unit  where  he 
engages  in  regular  flying  duties  as  a member  of  that  unit.  During  this 
and  subsequent  such  assignments,  the  pilot  increases  his  proficiency  in  the 
basic  skill  areas  covered  by  UPT  and  CCTS  and  acquires  additional  skills 
specific  to  the  operational  missions  of  the  unit  to  which  he  is  assigned. 
Having  reached  this  level,  the  pilot  continues  to  fly  training  and  opera- 
tional missions  that  serve  to  maintain  his  skills  at  the  level  required  for 
operational  readiness. 

As  long  as  the  Air  Force  pilot  is  in  a flying  assignment,  maintaining 
required  skill  levels  does  not  seem  to  be  a major  problem,  though  USAF 
devotes  continuing  attention  to  assure  this  result.  However,  the  USAF 
pilot  does  not  spend  his  entire  career  in  flying  assignments.  A wide  variety 
of  other  skills  is  required  of  USAF  officers,  both  rated  and  non-rated,  for 
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the  USAF  to  function  effectively.  Consequently,  the  USAF  career  pilot, 
after  his  initial  or  a subsequent  cockpit  tour,-  typically  is  assigned 
to  one  or  more  of  a variety  of  career-broadening  assignments  such  as  staff 
duty,  advanced  military  education,  or  possibly  advanced  civilian  education. 
In  such  an  assignment  he  becomes  part  of  the  "rated  supplement,"  that  force 
of  rated  pilots  in  non-flying  assignments  who  are  available  to  fill  cockpit 
positions  in  the  event  of  national  emergency  or  during  subsequent  assign- 
ments. In  order  to  prevent  their  piloting  skills  from  deteriorating  unduly 
during  such  non-flying  assignments,  most  pilots  in  the  rated  supplement  have 
been  required  to  engage  in  proficiency  flying  (PF)  in  which  they  are  re- 
quired to  fly  some  minimum  number  of  hours  per  calendar  period.  Such  flying 
is  referred  to  as  continuation  training.  While  the  amount  of  proficiency 
flying  required  has  varied  from  time  to  time  and  service  to  service,  it  has 
generally  been  in  the  range  of  80-120  hours  per  year.  The  exact  basis  on 
which  these  PF  requirements  were  established  is  not  known,  but  it  seems 
certain  that  it  was  not  on  the  basis  of  research  data. 

It  has  generally  been  held  that  flying  skills  must  be  exercised 
regularly  if  they  are  to  remain  at  the  level  required  by  USAF  combat  readi- 
ness requirements.  While  we  are  all  aware  of  popularly  held  positions 
with  reference  to  the  relative  permanence  over  time  of  certain  complex 
human  motor  skills  in  the  absence  of  practice  (e.g.,  bicycle  riding,  swim- 
ming, playing  the  piano,  etc),  no  one  seriously  questions  the  need  that 
pilot  skills  be  in  a state  of  currency  if  pilot  performance  is  to  be  safe 
and  effective.  In  real  life,  seldom  are  we  required  to  perform  non-flying 
skills  in  a situation  fraught  with  the  stress,  safety,  and  time-press  con- 
siderations that  characterize  aviation.  Even  the  accomplished  pianist  who 
might  demonstrate  convincingly  that  he  can  play  with  perhaps  considerable 

— Since  1970,  the  new  pilot  is  obligated  to  serve  at  least  five  years  in  a 
cockpit  assignment  after  completion  of  UPT. 
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competence  after  several  years  without  serious  practice,  or  perhaps  with 
no  practice  at  all,  would  not  likely  wish  to  appear  in  concert  without 
having  undergone  a rep. i men  of  recent  systematic  and  intensive  practice.  In 
considering  th>*  skills  of  the  p lot,  the  l!SAV  must  he  concerned  not  only 
with  the  stringent  requirements  attendant  to  operating,  the  aircraft  in 
a manner  that  guarantees  a high  probability  of  safety  for  the  aircrew, 
passengers,  and  others,  but,  even  more  important,  it  must  be  concerned  with 
guarantees  of  mission  accomplishment.  It  is  in  striking  the  proper  balance 
among  mission  r iqu i remen t s , training,  skil1  maintenance  requirements,  and 
available  resources  that  the  crux  of  the  resource  management  problem  lies. 

As  has  been  mentioned,  the  possibilitv  that  available  resources  will 
not  .alow  continuance  of  proficiency  flying  programs  for  some  or  all  rated 
supplement  pilots  has  become  one  whose  consequences  the  Air  Force  must 
examine.  Kven  granting  that  resources  might  permit  some  sort  of  continua- 
tion training,  the  Air  Force  must  examine  seriously  the  benefits  and  costs 
of  alternative  methods  of  force  management  under  current  and  future  condi- 
tions of  resource  limitation. 

SABKR  WINGS  H 

The  general  question  of  how  best  to  maintain  required  skill  levels,  or 
how  to  regain  them  if  they  are  not  maintained,  is  an  vycoedingly  complex 
one.  The  problem,  when  viewed  in  a systems  context,  involves  national 
defense  policy,  world  affairs,  the  inter-relations  among  combat  and  logis- 
tic systems,  military  management  factors,  and  a variety  of  matters  far 
beyond  the  concern  of  this  paper.  However,  a fundamental  aspect  of  the 
problem,  one  to  which  tills  paper  is  addressed,  is  that  the  problem  is  first 
and  foremost  a behavioral  one  that  deals  with  the  acquisition,  retention, 
and  reacquisition  of  flying  skills  by  pilots. 
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The  Office  of  the  Assistant  Chief  of  Staff,  Studies  and  Analysis,  Hq. , 
USAF,  has  undertaken  a major  study  concerned  with  the  general  problems  of 
management  of  pilot  manpower  resources  under  the  title,  SABER  WINGS  II. 

The  focus  of  that  study  is  maintaining  required  levels  of  pilot  readiness 
with  t lie  least  expenditure  of  training,  personnel,  and  fuel  resources.  It 
is  recognized  that  questions  relating  to  retention  of  flying  skills  as  a 
function  of  amount  and  type  of  flying  activity  are  significant  to  the  study. 
As  a consequence,  the  pn  r,e"t  effort  was  undertaken  to  provide  behavioral 
science  input  to  the  SABER  WINGS  II  effort. 

In  seeking  to  achieve  maximum  cost  benefits  In  its  force  management 
policies,  the  Air  Force  must  be  concerned  with  a number  of  questions  such 
as  tlie  following: 

• What  level  of  proficiency  defines  the  "combat-ready  pilot?" 

• How  does  one  measure  combat  readiness  of  individuals,  crews,  and 
units? 

• What  are  the  most  effective  and  efficient  means  of  achieving 
combat-ready  proficiency  levels? 

• How  much  and  what  kind  of  training  or  exercise  is  required  to 
maintain  combat-ready  proficiency  levels? 

• Wh.it  happens  to  proficiency  levels,  over  time,  as  a function  of 
amount  and  type  of  continuation  (proficiency)  training? 

• Are  current  proficiency  flying  programs  effective? 

• Is  any  proficiency  flying  required  for  rated  supplement  personnel? 

• What  are  rtie  effects  of  various  proficiency  flying  program  alter- 
natives (including  no  aircraft  flying)  on  pilot  motivation,  morale, 
and  retention  In  service? 

— ^ This  title  stems  from  an  earlier  USAF  study  entitled,  A Study  of  Pilot 
Proficiency  Flying  (Saber  Wings).  This  earlier  effort  is  discussed  else- 
where in  this  report. 
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• What  Ik  the  likelihood  that  a pilot  will  become  "unvlable"  If 


ne  enpar.es  In  no  proficiency  flying  during  a non-flving  assign- 
men  L ? 

This  last  question  concerning  the  '"unvlable"  pilot  requires  further 
comment.  There  is  no  precise  definition  for  the  concept  of  pilot  viability, 
bur  generally,  as  used  here,  it  refers  to  the  potential  capability  of  the 
pil  ot  to  assume  or  reassume  cockpit  responsibilities  in  an  effective  manner, 
in  timely  fashion,  and  at  a (re)training  cost  that  is  reasonable.  It  is 
sometimes  suggested  that  major  commands  are  reluctant  to  accept  a pilot 
for  a cockpit  assignment  after  a period  of  non-flying,  or  that  after  a 
certain  age  the  pilot  should  not  receive  certain  kinds  of  CCTS  training 
(e.g..  fighter)  because  of  higher  than  normal  probability  of  failure  in 
CCTS,  adverse  safety  factors,  or  operational  ineffectiveness.  Others  have 
maintained  that  continuity  of  exposure  to  the  rigors  of  flight  is  necessary 
if  motivation  to  fly  is  to  be  maintained  or  if  the  pilot  is  to  maintain 
his  ability  to  perform  effectively  under  stress.  As  can  be  surmised,  pilot 
viability  is  a function  of  many  factors  --  age,  motivation,  career  and 
family  interests,  flight  experience,  and  the  like.  While  all  such  factors 
are  of  potcncial  interest  to  SABER  WINGS  II,  the  present  report  generally 
seeks  to  examine  only  long-term  skill  retention,  and  factors  closely  related 
thereto,  as  they  pertain  to  the  concept  of  pilot  viability. 

The  question  addressed  here  deals  with  what  happens  to  pilot  flying 
skills  over  extended  periods  of  non-flying.  If  they  deteriorate  in  a 
fashion  that  precludes  their  cost-effective  reinstatement  for  all  or  some 
pilots  (e.g.,  certain  age  or  experience  groups),  then  the  concept  of  the 
unvlable  pilot  becomes  of  concern  in  the  management  of  the  rated  force.  The 
possibility  of  identifying  such  unvlable  pilots  would  be  of  interest  and 
would  be  a behavioral  question.  Remedial  measures  (e.g.,  use  of  simulators, 
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targeted  proficiency  flying,  "peaking"  of  pilot  skills  prior  to  a non- 
f lying  episode  to  minimize  skill  decay,  etc.)  designed  to  maximize  pilot 
viability  would  be  of  interest.  Thus,  there  are  a number  of  areas  of 
behavioral  concern  relevant  to  pilot  viability  that  require  information 
on  factors  related  to  long-term  flying  skill  retention  and  skill  reae- 
quisition.  It  was  with  this  general  orientation  that  the  review  of  the 
literature  reported  here  was  undertaken. 

The  next  section  of  this  report  deals  with  the  methodology  and  pro- 
cedures employed  in  this  review.  Subsequent  sections  present  omments 
on  the  literature  reviewed  and  relate  the  literature  to  Air  Force  problems 
being  addressed  in  the  SABER  WINGS  II  effort.  Finally,  certain  conclusions 
and  recommendations  for  Air  Force  consideration  are  presented. 


II.  STUDY  OBJECTIVE  AND  METHOD 


OBJECTIVE 

This  effort  was  undertaken  in  support  of  the  SABER  WINGS  II  study  with 
the  general  objective  of  reviewing  the  behavioral  science  literature  on  long- 
term retention  of  flying  skills  and  deriving  implications  for  future  USAF 
policies  relating  to  management  of  the  rated  force.  In  addition,  infor- 
mation was  desired  concerning  ongoing  research  activities  relevant  to  long- 
term flight  skill  retention.  Consequently,  the  effort  reported  here  vaa 
broken  into  three  principal  activities:  (1)  survey  and  review  of  literature 

sources;  (2)  survey  of  activities  and  experience  of  selected  research  and 
operational  agencies;  and  (3)  survey  of  selected  knowledgeable  research 
personnel . 

METHOD 

The  methods  used  in  carrying  out  the  three  main  thrusts  of  the  acti- 
vity are  described  below.  Since  this  is  basically  a literature  survey  and 
the  methods  used  were  conventional,  discussions  of  the  methods  will  be  kept 
relatively  brief. 

Literature  Survey 

The  general  methodology  of  the  literature  survey  is  described  in  the 
annotated  bibliography^  which  is  a companion  to  the  present  report.  It 
involved  search  of  various  HumRRO  libraries,  principally  that  of  the  HumRRO 
Pensacola  Office,  and  search  of  Defense  Documentation  Center  (DDC)  and 
National  Terhnical  Information  Service  (NTIS)  sources.  Libraries  consulted 
are  listed  in  the  Appendix.  In  addition,  some  documents  were  contributed  by 
various  professional  colleagues.  The  general  behavioral  science  literature 

— Prophet,  W.W.  Long-Term  Retention  of  Flying  Skills:  An  Annotated  Biblio- 

graphy. HumRRO  FR-ED(P) -76- 36 , Human  Resources  Research  Organization, 
Alexandria,  : October  1976. 
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was  accessed  through  Psychological  Abstracts  and  Dissertation  Abstracts. 

Many  titles  were  secured  from  previous  research  studies  and,  in  particular, 

the  earlier  literature  reviews  of  Sraode,  Hall,  and  Meyer  (1966),  Wright 

1/ 

(1969),  Gardlin  and  Sitterley  (1972),  and  Smith  and  Matheny  (1976). 

In  all,  approximately  2,000  references  were  "reviewed"  at  the  level  of 
reading  an  abstract  or  reference  to  the  item  In  another  source.  Of  course, 
only  a minority  of  these  items  were  really  pertinent.  The  annotated  bib- 
liography lists  some  120  citations  for  which  abstracts  or  annotations  are 
presented.  However,  even  a minority  of  these  are  of  central  concern,  so 
many  of  the  annotations  are  quite  brief.  Also,  there  are  some  instances 
in  which  a single  research  effort  may  be  reported  in  several  different 
citations,  e.g.,  as  a technical  report  and  as  an  article  in  a professional 
journal.  In  addition,  the  annotated  bibliography  lists  some  80  other  refer- 
ences, not  annotated,  which  were  reviewed,  but  were  evaluated  as  "not  perti- 
nent." These  latter  are  listed  for  reader  information  only,  in  view  of  the 
fact  that  many  have  titles  or  abstracts  that  sounded  pertinent  but,  in  fact, 
were  not. 

A££  ncy  Survey 

In  addition  to  libraries  and  various  other  documentary  sources,  a 
survey  was  conducted  of  selected  research  laboratories,  university  or  college 
agencies,  airlines,  and  federal  and  other  agencies  concerning  their  acti- 
vities, experiences,  or  programs  that  might  deal  with  long-term  flight 
skill  retention.  These  various  agencies  are  listed  in  the  Appendix. 


— Reference  to  documents  covered  in  the  basic  bibliographic  listing  of  the 
annotated  bibliography  companion  report  (HumRRO  FR-ED(P)-76-36)  will  be  made 
in  the  above  fashion  In  the  present  report.  Such  items  discussed  in  the 
present  report  are  listed  in  the  bibliography  at  the  end  of  this  report.  This 
listing  is  less  extensive  than  that  of  the  annotated  bibliography  since  not 
all  items  covered  in  the  annotated  bibliography  are  discussed  here.  Refer- 
ence in  the  present  report  to  items  not  listed  in  the  annotated  bibliography 
report  will  be  through  the  use  of  footnote  citations  as  were  used  in  1 apter  I. 
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Contact  with  these  agencies  was  by  mail  or  telephone  primarily,  but 
in  some  cases  visits  were  made  by  the  author  or  an  associate.  Information 
sought  was  of  several  types: 

(1)  Specific  programs  or  research  concerned  with  long-term  flight 
skill  retention.  For  example,  were  'jny  of  the  service  laboratories  en- 
gaged in  research  on  the  subject,  have  the  airlines  analyzed  data  dealing 
with  retraining  of  pilots  after  extended  non-flying  periods,  etc. 

(2)  Knowledge  of  programs  or  research  by  other  agencies. 

(3)  Suggestions  as  to  persons  to  contact. 

(4)  General  comments  on  long-term  flight  skill  retention. 

Survey  of  1 nilviduals 

Certain  individuals  likely  to  be  knowledgeable  concerning  long-term 
retention  of  flight  skills  were  contacted  face-to-face,  by  mail,  or  by 
telephone.  In  some  cases,  these  individuals  were  affiliated  with  one  of 
the  agencies  contacted,  hut  In  other  instances  they  were  contacted  because 
of  their  general  expertise,  rather  than  agency  affiliation.  These  persons 
were  colleagues  known  to  the  author  or  suggested  by  others  as  likely  sources 
of  informed  input.  The  individuals  ate  listed  in  the  Appendix. 

By  fortunate  temporal  coincidence,  one  of  the  research  staff  on  this 
project  was  presenting  a paper — ^ in  England  and  consulting  with  the  Royal 
Swedish  Air  Force  during  the  conduct  of  the  present  survey  activities.  This 
allowed  contact  to  be  made  with  personnel  from  European  agencies,  and  at 
the  RAF  Institute  of  Aviation  Medicine,  concerning  research  activities  in 
Europe  related  to  long-term  flight  skill  retention.  Whlie  there  was  con- 
siderable interest  in  the  problem  area  and  anecdotal  information  was  offered, 

— Caro,  P.W.  Some  Factors  Influencing  Transfer  of  Simulator  Training.  Paper 
for  Third  Flight  Simulation  Symposium  of  the  Royal  Aeronautical  Society, 
London,  England,  April  1 9 7 (3 . Published  as  HumRRO  Professional  Paper  1-76, 
Human  Resources  Research  Organization,  Alexandria,  VA,  August  1976. 
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unfortunately  no  documentation  or  reports  of  research  or  other  efforts 
of  significance  in  the  present  context  were  found. 

GENERAL  SCOPE  OF  SURVEY 

While  further  search  would  undoubtedly  turn  up  additional  items  of 
interest,  it  is  felt  that  most  of  the  major  extant  items  on  the  subject 
were  located  and  are  represented  in  the  two  reports  that  resulted.  The 
topic  of  long-term  flight  skill  retention  is  not  a new  one,  obviously,  and 
its  importance  has  been  recognized  for  many  years,  as  evidenced  by  the  fact 
that  research  on  the  subject  has  been  conducted.  Horever,  the  amount  of 
research  and  data  revealed  in  the  present  examination  seems  meager  when 
compared  with  the  potential  importance  of  the  topic. 

It  should  be  noted  here  that  the  focus  of  the  present  review  was  kept 
somewhat  narrow  in  the  sense  that  emphasis  was  on  direct  studies  of  flight 
skills  or  of  skills  that  could  be  easily  related  to  the  flight  situation. 

No  at  empt  was  made  to  cover  in  depth  the  academic  and  research  literature 
dealing  with  the  general  subjects  of  learning  and  retention.  The  bulk  of 
this  literature  deals  with  verbal  learning,  as  opposed  to  skills  learning, 
and  is  voluminous  far  beyond  the  capability  of  the  present  study's  resources 
to  cover.  Move  important,  it  is  of  marginal  interest  in  the  present  context 
of  providing  input  for  USAF  policies  on  flying  programs  and  force  management. 
However,  that  literature  is  adequately  represented  here  in  the  competent 
work  of  Adams  (1967),  Naylor  and  Briggs  (1961),  and  others.  The  focusing 
of  the  present  search  on  motor  skills  retention,  particularly  flight  re- 
lated skills,  in  no  way  is  intended  to  denigrate  the  quality  or  importance 
of  the  more  general  body  of  literature. 
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III.  RESULTS 


THE  NATURE  OF  FLYING  SKILLS 

Before  discussing  the  Literature  on  long-term  retention  of  flying 
skills,  it  may  be  advantageous  to  discuss  the  nature  of  the  USAF  pilot's 
task  and  the  flying  skills  of  concern  here.  It  is  clear  that  the  tasks 
the  pilot  of  a modern  military  aircraft  must  perform  are  many  and  complex. 
There  are  few  task  situations  that  demand  as  much  of  the  performer  in  terms 
of  physical  strength  and  endurance,  fine  perceptual  and  motor  discrimina- 
tions, cognitive  functioning,  verbal  communication  skills,  decision  making, 
and  the  like,  as  does  that  of  flying  an  aircraft.  Also,  there  are  few  per- 
formance environments  or  situations  that  produce  the  task-time  press,  the 
general  physiological  and  psychological  stress,  and  bodily-harm  threat  as 
does  the  flight  situation,  particularly  in  the  combat  setting. 

Prior  Research 

If  one  sought  to  deduce  the  nature  of  the  pilot's  task  from  the  content 
of  the  research  literature,  he  might  conclude  that  it  is  fairly  simple, 
consisting  mainly  of  requirements  to  track  erratically  moving  spots  of  light 
on  the  face  of  CRTs  through  manipulation  of  a joy-stick  control,  or  he  might 
conclude  that  it  consisted  of  rapidly  manipulating  toggle  switches  or  push- 
ing buttons  in  response  to  multi-colored  and  multi-patterned  displays  of 
flashing  lights.  In  fact,  a substantial  number  of  studios  in  the  aviation 
psychology  literature  have  involved  variants  of  one  or  the  other  of  these 
types  of  tasks  because  there  has  been  a great  emphasis  on  the  study  of 
tracking  and  procedcnal  task  skills.  These  two  dimensions  are  undoubtedly 
critical  components  of  pilot  skills,  but  there  are  others  that  have  received 
considerably  less  research  attention. 

One  reason  for  the  emphasis  described  above,  of  course,  is  that  of 
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amenability  to  experimental  control  and  the  production  of  reliable  data. 
Another  and  more  important  factor,  however,  is  that  most  researchers  con- 
ccerned  with  aviation  skills  have  been  primarily  interested,  in  one  way  or 
another,  in  the  initial  acquisition  of  pilot  skills  and  in  factors  that 
facilitate  or  inhibit  such  acquisition.  Consequently,  there  has  been  much 
more  research  attention  devoted  to  skill  acquisition  at  the  UPT  skill  level 
than  at  advanced  skill  levels.  Since  much  of  the  learning  activity  in- 
volved at  the  t'PT  skill  level  is  related  to  the  perceptual-motor  skills 
required  to  control  the  aircraft  in  space  with  some  degree  of  precision  and 
reliability  (tracking),  and  in  learning  the  complex  spatial-temporal  rela- 
tionships that  relate  to  execution  of  tasks  in  the  cockpit  environment 
(procedures),  the  research  emphasis  is  not  surprising.  Neither  is  it  sur- 
prising that  this  conception  of  the  pilot's  task  is  also  reflected  in  much 
of  the  retention  research  examined  here. 

Phases  of  Skill  Acquisition 

As  a framework  for  examining  research  on  pilot  skill  acquisition,  the 

discussion  of  phases  in  the  acquisition  of  complex  perceptual-motor  skills 

by  Smode,  Hall,  and  Meyer  (1966)  is  of  some  interest.  Their  account,  which 

1/ 

leans  heavily  on  Ideas  advanced  by  Fitts,-  describes  three  phases  in  skill 
acquisition:  (1)  the  Early  (Cognitive)  Phase;  (2)  the  Intermediate  (Fix- 

ation) Phase;  and  (3)  the  Late  (Autonomous)  Phase.  In  the  early  phase  the 
student  seeks  to  develop  a cognitive  structure  of  the  task  that  will  allow 
him  to  practice  it,  while  In  the  second,  or  fixation,  phase  the  perceptual 
and  response  patterns  are  fixed  through  practice  so  that  there  is  less  and 
less  reliance  on  verbal  mediation  of  response  integration.  UPT  training, 

— Fitts,  P.M.  "Factors  in  Complex  Skill  Training."  In  R.  Glaser  (Ed.) 
Training  Research  and  Education.  Pittsburgh:  University  of  Pittsburgh 

Press,  1962,  177-197. 
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and  probably  at  least  the  initial  CCTS  training  course,  can  be  classified 
as  spanning  these  first  two  phases. 

It  is  performance  during  the  thi^d  phase  of  skill  development  that 
is  ot  most  Interest  to  the  USAF  with  reference  to  the  long-term  retention 
area.  As  noted  earlier.  Air  Force  concern  in  this  area  is  related  to 
management  of  personnel  at  very  high  skill  levels,  personnel  who  have  under- 
gone one  or  more  operational  tours  before  being  faced  with  a non-flying 
assignment.  The  comments  of  Smode,  Hall  and  Meyer  (1966)  concerning  this 
third  phase  are  worthy  of  quoting: 

"This  phase,  for  which  little  experimental  data  are  available, 
represents  a very  gradual,  but  continuing,  improvement  in  profi- 
ciency. In  addition,  performance  becomes  more  resistant  to  stress 
and  to  interference  from  other  activities  that  may  be  performed 
concurrently.  Fitts  refers  to  neurological  evidence  indicating  less 
and  less  involvement  of  cortical  associative  areas  as  learning  con- 
tinues in  the  case  of  simple  conditioned-response  learning,  thus 
supporting  the  idea  that  this  stage  of  autonomous  behavior  is  based 
on  a shift  from  reliance  on  visual  to  reliance  on  proprioceptive 
feedback,  a shift  of  control  to  lower  brain  centers,  and  similar 
changes."  (p.  26) 

This  third  phase  is  seen  as  spanning  some  years  as  the  pilot  or  per- 
former approaches  the  performance  peak  that  is  characteristic  of  the  true 
professional  pilot.  In  fact,  it  is  suggested  that  this  slow  increase  in 
competence  might  continue  indefinitely  with  regular,  intensive  practice, 
were  it  not  for  the  effects  of  physiological  aging  and/or  loss  of  motiva- 
tion. The  point  to  be  noted  here  is  that  this  is  the  phase  of  the  acquisi- 
tion process,  or  really,  the  phase  of  the  pilot's  career,  of  most  interest 
to  the  Air  Force  with  reference  to  skill  maintenance/retention/relearning 
questions;  but,  it  is  the  one  to  which  the  least  research  attention  has 
been  devoted. 

Re  search  o n Abi 1 1 ties  and  Skills 

While  it  does  not  follow  that  the  data  on  retention  or  acquisition 
that  have  been  developed  on  early  and  intermediate  phase  skill  levels  are 
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not  applicable  to  the  late  phase  level,  there  is  research  that  raises 
some  question  In  tills  regard.  There  has  been  considerable  research  on 
the  fundamental  nature  of  ski  Lis,  the  development  of  task  or  behavioral 
taxonomies,  and  related  matters.  One  important  line  of  such  research  is 
that  of  Fleishman  and  his  associates  concerned  with  the  factorial  structure 
of  motor  skills.  While  systematic  review  of  this  area  of  psychological 
research  is  beyond  the  scope  of  this  paper,  several  studies  are  relevant. 

In  one,  Fleishman  and  Ornstein  (1960)  investigated  the  underlying  ability 
structure  of  flying  performance  at  various  levels  of  training,  while  in 
another  series  of  investigations  (Parker  and  Fleishman  (1959),  Parker 
and  Fleishman  (1960),  Fleishman  and  Parker  (1962)),  the  relationship  of 
ability  factors  to  skill  retention  was  investigated.  The  aspect  of  these 
investigations  of  interest  to  the  present  discussion  is  Fleishman's  con- 

17 

tentlon  that  the  structure  of  the  task,  in  terms  of  human  ability  factors 
required  for  its  performance,  changes  with  1 'vel  of  skill  or  amount  of  prac- 
tice. Thus,  according  to  this  line  of  reasoning,  the  set  of  ability  factors 
required  for  success  in  early  UPT  training  is  different  from  that  required 
at  a mid-point,  and  both  Sets  might  differ  from  the  set  of  abilities  re- 
quired later  in  training.  If  this  be  the  case,  it  is  reasonable  to  assume 
that  there  is  further  change  as  the  experienced  pilot  moves  into  and  through 
the  third  phase  of  skill  acquisition  described  by  Smode,  Hall,  and  Meyer 
(1966).  It  is  also  possible  that  retention  research  based  on  ability  struc- 
ture. characteristic  of  earlier  stages  of  skill  development  might  produce 

.17 

A distinction  is  made  here  between  'ability"  and  "skill."  An  ability  is 
conceived  as  a fundamental,  stable  aspect  of  the  individual  such  as  verbal 
reasoning  ability,  while  skills  are  acquired  or  learned  ways  of  using 
abilities.  Thus,  according  to  this  conception,  one  may  acquire  varying 
levels  of  skill  in  a verbal  reasoning  task,  depending  on  practice  and  the 
amount  of  underlying  ability,  but  the  ability  does  not  change. 
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results  and  conclusions  different  from  those  that  would  be  found  at  the 
more  advanced  stage,  a stage  for  which,  unfortunately,  all  too  little 
research  has  been  done. 

The  matter  is  further  complicated  by  the  line  of  research  that 
suggests  that,  rather  than  the  character  of  the  task,  changing  with  prac- 
tice while  the  underlying  abilities  of  the  individual  remain  constant,  it 
is  the  basic  ability  structure  of  the  individual  that  changes  while  the 
task  structure  remains  constant.  In  a series  of  papers  by  Hulln  and  Al- 
varos (1971,  n,b,c)  they  conclude  that  the  data  support  a third,  or  com- 
bination, model  and  that  both  types  of  changes  occur  in  the  acquisition 
of  flying  skill.  The  importance  of  Such  research  to  the  present  context 
lies  in  the  possibility  that  not  only  are  we  faced  with  the  change  in  skill 
level  over  time  during  non-flying  or  reduced  flying  periods  (the  retention/ 
decrement  function),  hut  that  there  may  be  changes  in  both  the  task  struc- 
ture and  the  individual's  underlying  abilities.  As  stated,  there  is  too 
little  research  dealing  with  advanced  skill  levels  to  provide  a sound 
basis  for  conclusions  on  questions  of  this  sort. 

The  Pilot  as  Information  Processor 

However,  the  subject  of  the  nature  of  the  flying  skills  of  the  opera- 
tional USAF  pilot  can  be  viewed  in  less  esoteric  terms.  It  can  be  main- 
tained on  a basis  of  rational  analysis  of  the  tasks  involved  that  the  more 
critical  aspects  of  advanced  flying  skill  levels  nre  those  dealing  with 
identification  and  acquisition  of  relevant  information  (in  terms  of  both 
tactical  and  aircraft  situations),  the  processing  of  such  information, 
decision  making,  system  management  (including  tactical,  aircraft,  and  human 
systems),  and  similar  "higher  level"  functions.  Another  critical  aspect 
of  advanced  flying  skills  often  cited  is  the  ability  to  perform  reliably 
functions  such  as  the  preceding  (as  well  as  those  old  favorites,  tracking 
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and  procedures)  while  under  conditions  of  great  psychological  and  physio- 
logical stress. 

in  line  with  the  concept  of  the  skilled  pilot  as  an  information  pro- 
cessor and  executive  agent  is  the  work  of  researchers  who  have  been  con- 
cerned with  the  pilot's  ability  to  function  in  a dual-  or  multi-task  situ- 
ation. It  is  assumed  that  the  individual  Is  limited  in  both  information 
channel  and  processing  ability  and,  thus,  in  any  given  task  load  situation 
has  onlv  a limited  amount  of  "spare"  capacity  or  attention  that  can  be 
devoted  to  other  tasks.  As  pilot  skill  increases,  this  residual  or  spare 
capacity  increases  as  perceptual  discriminations  and  responses  are  fixated 
or  become  autonomous.  Hence,  the  mark  of  the  highly  skilled  pilot  may  be 
that  he  can  take  '-are  of  the  routine  aircraft  "housekeeping"  tasks  and 
have  more  attention  available  o devote  to  tactical  management  and  decision 
making  requirements.  A number  of  researchers  have  pursued  this  line  of 
research,  as,  for  example,  Gopher  and  North  (1974),  who  describe  a means 
of  measuring  operator  capacity.  But,  no  studies  of  flight  skills  retention 
based  on  this  conception  were  found. 

As  can  be  deduced  from  the  preceding  discussion,  the  nature  of  flight 
skills  can  he  viewed  as  a fairly  simple  composite  of  stimulus-response 
habit  patterns  concerned  largely  with  tracking  and  procedural  tasks,  or  as 
a much  more  complex  composite  of  those  skills  (operating  in  autonomous  or 
near-autonomous  fashion)  plus  a variety  of  higher  level  processes  devoted 
much  more  to  management  of  the  aircraft,  weapons,  and  other  personnel  as 
an  integrated  system  in  the  accompl lshnent  of  goal-oriented,  mission  be- 
havior. The  question  of  long-term  retention  of  flying  skills  for  pilots  at 
the  higher,  professional  skill  levels  of  the  USAF  pilot  population  for  whom 
non-flying  assignments  are  a matter  of  management  concern  should  probably 
be  cast  In  the  more  complex  view  of  pilot  skills  described. 
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Combat  Read ine s_s 

Another  aspect  of  the  nature  of  flying  skills  with  which  USAF  force 
management  is  concerned  is  the  definition  and  measurement  of  combat  readi- 
ness. What  are  the  characteristics  of  the  combat-ready  pilot,  for  it  is 
the  retention/mnir ; ?nance/retralning  of  tills  level  of  proficiency  with 
v’.ich  force  management  must  be  concerned.  Obviously,  pilot  skills  must 
be  maintained  at  a level  that  assures  that  the  USAF  can  meet  its  various 
combat  contingency  requirements.  This  carries  connotations  of  level  of 
performance,  reliability  of  performance,  numbers  of  personnel,  and  time  to 
train,  retrain,  or  reassign  personnel  to  meet  aurgo  , drawdown,  and  rotation 
requirements.  There  are  a number  of  alternative  force  management  models 
that  might  accomplish  these  ends  at  varying  costs  or  with  varying  trade- 
off advantages  and  disadvantages. 

As  might  be  deb  'ed  from  the  preceding  observations  concerning  the 
dearth  of  research  on  higher  pilot  skill  levels,  the  areas  of  definition 
and  measurement  of  combat  readiness  have  also  been  neglected.  There  are 
many  penetrating  analyses  of  a non  research  nature  that  have  been  made  of 
these  areas  --  analyses  that  may  be  quite  valid  --  but  relatively  little 
has  been  accomplished  at  this  level  of  skill  by  the  behavioral  researchers. 
Some  observers  have  developed  positions  concerning  combat  readiness  that 
may  be  based,  at  least  in  part,  on  behavioral  research.  For  example,  Stewart 
(1971)  states  (p.  13-14),  "To  be  combat-effective,  that  is  to  be  capable  of 
performing  reliably  and  accurately  under  the  stress  of  combat,  the  pilot 
must  have  attained  a level  of  experience  (flying  hours),  judging  from  the 
limited  evidence  available,  such  aj  to  require  about  four  years  of  flying 
after  graduation  from  UPT."  Thus,  Stewart  equates  combat  readiness  with 
the  accumulation  of  about  1,200  hours  of  total  flight  experience.  The 
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difficulty  of  this  approach  to  defining  combat  readiness  ie  that  it  does 
not  say  what  the  skills  are,  or  what  levels  of  proficiency  are  Involved, 
in  a manner  that  allows  objective  measurement  or  consideration  of  alterna- 
tive means  for  achievement.  This  is  not  to  suggest  at  all  that  the  develop- 
ment of  combat  readiness  is  purely  a random,  trial-and-error  process  that 
occurs  in  operational  units  with  no  management  or  control.  Rather,  it  is 
to  say  that  the  nature  of  these  skills  has  not  been  well  articulated,  and 
very  little  research  data  on  them  exist  that  can  be  used  in  force  manpower 
management  models.  Use  of  relatively  simple  indices  such  as  total  flying 
hours,  age,  rank,  etc.,  in  management  models  is  understandable  because  of 
their  simplicity  and  availability,  and  because  of  lack  of  more  precise 


behavioral  data  to  use  as  inputs. 


ORGANIZATION  OF  THE  LITERATURE  REVIEW 


In  presenting  the  results  of  a survey  of  literature  and  information 
in  a topical  area,  there  are  numerous  alternative  ways  that  one  might 
organize  the  review.  In  the  present  case,  the  following  organization 
outline  will  be  followed: 

1.  General  comments  on  the  recent  literature. 

2.  Discussion  of  other  general  reviews  of  the  literature. 

3.  Discussion  of  specific  aviation-related  studies  of  skill 
retent  ion . 

No  attempt  will  be  made  to  treat  each  of  the  120  items  covered  in 
the  companion  annotated  bibliography,—^  since  many  of  those  items  are 
of  minor  significance.  Rather,  the  aim  will  be  to  treat  those  items  of 
principal  concern  to  the  USAF  with  reference  to  long-term  retention  of 
flying  skills.  In  the  subsequent  chapters  of  this  report  the  literature 
and  other  information  will  be  discussed  and  major  conclusions  formulated. 


— Prophet,  W.W.  Long-Term  Retention  of  Flying  Skills:  An  Annotated 

Bib  1 logr aphy . HumRRO  FR-ED(P)-76-36,  Human  Resources  Research  Organi- 
zation, Alexandria,  VA,  October  1976. 
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GENERAL  COMMENTS  ON  THE  LITERATURE 


Human  meuory  was  the  first  area  of  psychological  content  to  receive 
systematic  scientific  attention.  The  beginning  of  scientific  study  of 

the  area  is  usually  dated  from  1885,  the  year  Hermann  Ebbinghaus  published 

1/ 

his  classic  report  of  his  studies  of  memory.  Sinci  that  time,  thousands 
of  papers  on  memory  and  retention  have  been  published,  dealing  primarily 
with  the  subject  of  verbal  learning  and  memory.  As  has  been  noted,  con- 
siderablv  less  attention  has  been  devoted  to  the  retention  of  perceptual- 
motor  skills  than  of  verbal  skills.  While  the  verbal  learning  literature 
is  of  potential  significance  to  USAF  concern  with  flying  skill  retention, 
that  potential  was  felt  to  be  so  slight  that  it  did  not  warrant  committment 
to  the  verbal  skills  area  of  a significant  portion  of  the  limited  resources 
available  for  the  present  review.  Fortunately,  much  of  that  literature 
pertinent  to  long-term  retention  was  reviewed  at  length  by  Naylor  and 
Briggs  (1961)  in  their  comprehensive  paper,  so  the  present  review  does  not 
rover  that  ground  again. 

In  examining  the  literature  relevant  to  flight  skills  retention,  it 
is  obvious  that  direct  concern  with  this  area  by  the  military  services  is 
a fairly  recent  development,  essentially  dating  back  only  to  the  late  1950s 
when  the  USAF  began  to  consider  extended  space-flight  missions  and  the 
demands  such  missions  might  make  on  skill  retention.  There  was  some  flurry 
of  concern  with  the  topic  in  the  early  1950s  when  a number  of  World  War  II 
pilots  were  called  back  into  service  during  the  Korean  conflict,  but  this 
concern  did  not  result  in  substantial  research  programs. 

As  a result  of  the  emergence  of  manned  spaceflight  in  the  late  1950s 

- Ebbinghaus,  H.  Uber  das  Gedachtnis:  Untersuchungen  zur  experimentellen 

Psychologle ■ Duncker  and  Humbolt,  Leipzig,  Germany,  188^. 
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and  1960s,  the  USAF  and  NASA  embarked  on  a number  of  studies  of  skills 


retention  during  the  1960s  and  1970s.  Concurrent  with  this  development 
was  the  appearance  in  the  1960s  of  concern  hy  the  services  with  their 
various  programs  of  proficiency  flying  < P F ) or  combat  readiness  training 
(CRT).  This  concern,  which  was  prompted  hy  congressional  and  budgetary 
pressures,  led  to  several  studies  of  proficiency  flying  programs  such  as 
that  ot  Caines  and  Danoff  (1967),  in  which  both  USAF  and  USN  programs  were 
examined,  Kusewitt's  (1968)  study  of  Navy  CRT  programs,  the  l!SAF  Saber 
Win^s  study  (1969),  the  Wright  (1969,  1973)  and  HumRRO  (1974)  studies  of 
II, S.  Army  CRT/PF  programs.  Of  these  proficiency  flying  studies,  only 
those  of  the  Army  were  specifically  concerned  with  [light  skill  retention 
after  periods  of  no-flying.  The  only  study  of  flight  skills  retention  by 
USAF  of  recent  times  was  the  examination  of  the  retraining  records  of  Viet- 
nam POW  returnees,  as  reported  in  Armstrong,  Bleymaier,  hinkel,  Levin9, 
and  Sheppard  (1975)  and  in  Smitii  and  Matheny  (1976).  This  was  a post  hoc 
examination  of  data  of  opportunity,  rather  than  a planned  Investigation. 

During  the  past  decade,  some  investigations  of  skill  retention  have 
also  been  carried  out  by  the  FAA  and  the  airline  industry.  These  studies 
were  not  particularly  concerned  with  retention  after  periods  of  non-flying, 
except  by  chance,  since  their  purposes  were  more  related  to  decay  of  aspects 
of  skill  among  persons  still  flying  or  to  the  training  of  certain  groups 
as  In  the  upgrading  of  airline  second  officers. 

One  might  conclude  that  with  the  military  services,  FAA,  NASA,  and  the 
airline  industry  all  having  some  degree  of  interest  in  the  topic,  there  would 
be  a good  deni  of  research  activity  on  the  subject  of  long-term  retention 
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of  f lying  skills.  Such,  unfortunately.  Is  not  the  case.  The  11SAF-NASA 
combination  has  produced  some  significant  research  in  the  spaceflight 
context,  but  the  l:SAF  has  devoted  little  recent  experimental  research 
attention  to  the  subject  in  the  aircraft  context.  The  Navy  has  given 
the  subject  no  official  attention,  other  than  the  Knsewitt  (1968)  study, 
which  was  really  aimed  at  defining  the  recommended  nature  of  CRT  programs, 
not  the  studying  of  retention.  Only  the  Army  among  the  military  services 
has  mounted  deliberate,  experimentally  oriented  studies  of  retention  during 
recent  times.  No  cut  rent  research  on  the  subject  by  either  US  or  foreign 
agencies  was  found  to  he  in  progress,  so  it  is  not  a highly  active  area. 

One  way  to  assess  the  research  activity  on  long-term  flight  skills 
retention  is  to  compare  sources  covered  in  the  present  survey  with  those 
of  its  two  major  predecessors,  Naylor  and  Briggs  (1961),  and  Gardlin  and 
Sitterlev  (19/2) . Naylor  and  Briggs  covered  123  references,  while  Gardlin 
and  Sitterley  had  116.  The  annotated  bibliography  * of  the  present  effort 
contains  120  references.  Table  1 shows  the  publication  year  of  the  refer- 
ences covered  in  these  three  reviews.  While  some  pre-World  War  II  refer- 
ences are  contained  in  the  Naylor  and  Briggs  review,  it  is  apparent  that 
the  greatest  concentration  of  research  activity  has  been  from  1960  on. 

In  examin  iii);  Table-  1,  it  should  be  kept  in  mind  that  there  is  some 
overlap  among  the  three  reviews,  most  notably  between  that  of  the  present 
author  and  that  of  Gardlin  and  Sitterley  (1972).  Table  2 depicts  the  degree 
of  overlap.  As  can  be  seen,  36  items  are  common  to  the  current  review  and 
that  of  Gardlin  and  Sitterley,  while  the  present  review  contains  79  items 


— Prophet,  W.W.  Op.  cit. 
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TABLE  l 


PUBLICATIONS 

REVIEWED  - BY 

YEAR  OF  PUBLICATION 

, . 0,1/ 
Literature  Review- 

of  Publication 

Na  y 1 o r & 
Briggs 

Card  1 in  & 
Sitterley 

Prophet 

1975  - 

0 

0 

6 

1970-1974 

0 

4 

40 

1965-1969 

0 

62 

40 

1960-1964 

1 

37 

25 

1955-1959 

25 

8 

6 

1950-1954 

28 

5 

1 

1945-1949 

5 

0 

1 

1940-1944 

11 

0 

1 

1935-1919 

14 

0 

0 

1930-1934 

19 

0 

0 

1925-1929 

6 

0 

0 

1920-1924 

6 

0 

0 

1915-1919 

3 

0 

0 

1910-1914 

2 

0 

0 

1905-1909 

2 

0 

0 

1900-1904 

0 

0 

0 

1895-1899 

0 

0 

0 

1890-1894 

0 

0 

0 

1885-1889 

1 

0 

0 

Total 

1 23 

116 

120 

— Reference  is  to  reviews  by  Naylor  and  Briggs  (1961),  Card  1 in  and  Sitterley 
(1972),  and  Prophet  (1976)  Op.  cit. 
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n<t  in  the  other  two.  Only  three  items  are  found  in  all  three  of  the 
reviews . 

TABLE  2 

COMMONALITY  OF  THREE  LITERATURE  REVIEWS 


1 ' 

Author (s) 

Naylor  only 

Gardlin  only 

Prophet  only 

Nnylor-Gnrdlin 

Nay lor-Prophet 

Gar dl In-Prophet 

Nay lor-Cardl in -Prophet 


Number  of  Items  Rev lewed 

113 

72 

79 

5 

2 

36 

3 

Total  310 


See  footnote.  Table  1. 

More  important,  however,  is  the  content  of  these  various  studies. 
Naylor  and  Briggs  (1961)  state  that  most  of  the  literature  they  cover  is 
concerned  with  verbal,  rather  than  motor,  behavior.  They  note  that  pub- 
lished studies  of  skills  retention  had  appeared  at  the  rate  of  only  about 
two  per  year  from  1900  to  1960,  but  that  many  of  those  were  only  tangen- 
tially relevant  to  USAF  concern.  Gardlin  and  Sltterley  (1972)  describe 
skill  retention  studies  as  involving  three  types  of  tasks,  generally:  (1) 
simulation  tasks;  (2)  tasks  involving  essential  elements;  and  (3)  abstract 
tasks  of  only  peripheral  relevance.  The  latter  category,  they  state,  is 
descriptive  of  the  majority  of  studies  in  the  Naylor  and  Briggs  review. 

In  the  more  recent  literature,  the  second,  or  essential  elements,  type  of 
task  accounts  for  most  of  the  research,  while  the  use  of  simulation  is 
receiving  increasing  attention  in  skill  retention  studies.  As  might  be 
deduced  from  these  comments,  direct  studies  of  flight  skills  retention  in 
the  actual  flight  setting  are  few  in  number. 
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In  terms  of  research  content  of  the  more  recent  studies,  length  of 
retention  interval,  level  of  pre-retention  interval  proficiency,  effects 
of  rehearsal,  use  of  simulation  in  retraining,  and  transfer  task  fidelity 
are  some  of  the  major  variables  studied.  Others  include  task  type  (e.g., 
tracking  vs.  procedure),  age,  and  task  organization.  However,  most  of 
these  variables  have  not  been  attended  to  as  part  of  an  integrated  research 
effort  concerned  with  pilot  skills  retention.  It  is  unfortunate  that  the 
suggestions  for  development  of  an  integrated  research  approach  on  long- 
term flight  skills  retention,  such  as  advanced  by  Naylor  and  Briggs  (1961) 
and  Smode,  Hall,  and  Meyer  (1966),  have  not  been  pursued  by  the  USAF  and 
othets  to  develop  the  data  base  and  conceptual  understanding  needed  for 
current  and  future  force  management  policy  determinations. 

PREVIOUS  LITERATURE  REVIEWS 

As  has  been  noted,  the  Naylor  and  Briggs  (1961)  review  is  generally 
acknowledged  as  the  first  major  review  of  long-term  skills  retention  rele- 
vant to  current  USAF  concerns.  Subsequent  reviews  (e.g.,  Smode,  Hall, 
and  Meyer  (1966),  Wright  (1969),  and  Gardlin  and  Sitterley  (1972))  have 
relied  on  Naylor  and  Briggs  as  an  adequate  summary  of  the  literature  for 
the  first  60  years  of  this  century.  The  present  effort  affirms  that  view 
of  Naylor  and  Briggs  as  an  excellent  summary.  While  we  do  not  intend  here 
to  examine  the  Naylor  and  Briggs  review  in  detail  , its  major  conclusions 
will  be  discussed  as  they  relate  to  our  topic  of  concern.  For  more  ex- 
tensive treatment  of  their  reivew,  the  reader  is  referred  to  the  original 
document  (Naylor  and  Briggs  (1961)),  to  the  Gardlin  and  Sitterley  (1972) 
review,  or  to  the  annotated  bibliography— ^ companion  to  this  report. 

— ^Prophet,  W.W.  Op.  cit. 
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The  other  ...jjor  review  of.  interest  is  that  of  Gardlin  and  Sitterley 
(1972).  Their  review  was  motivated  by  an  interest  quite  similar  to  the 
present  one,  i.e.,  NASA's  interest  in  long-term  retention  oi  piloting 
skill.',  except  for  spacecraft  rather  than  aircraft.  They  review  some  116 
items,  of  which  99  are  dated  in  the  1960s.  Thus,  their  review  can  be 
characterized  as  covering  the  decade  of  the  1960s.  It  also  contains  more 
studies  of  direct  pertinence  to  our  present  context  than  did  the  Naylor 
and  Briggs  (1961)  review. 

The  present  review,  as  reflected  in  the  companion  report^  cannot 
really  he  characterized  as  covering  the  decade  of  the  1970s  because  of 
its  date,  but  96  (38%)  of  the  120  items  reviewed  were  published  1970  or 
later.  Some  50%  of  the  items  carry  1960s  publication  dates,  while  the 
1950s  and  1990s  account  for  only  6%  and  2%,  respectively. 

While  there  is  some  overlao  in  coverage,  as  noted,  among  the  three 
reviews,  it  can  be  seen  that  there  has  been  an  increasing  flow  of  research 
dealing  with  the  subject  of  long-term  skills  retention.  It  would  be  a 
mistake  to  assume,  however,  that  the  problem  is  receiving  adequate  research 
attention,  for  of  the  several  hundred  studies  included  in  this  review,  only 
a relative  handful  deal  with  skills  of  the  magnitude  of  complexity  of  air- 
craft piloting,  and  very  few  deal  with  retention  time  intervals  similar  to 
those  of  concern  to  the  USAF  (1-3  years). 


1/ 


Prophet,  W.W. 


Op.  cit. 
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Naylor  arm  Rri£g_s  Review 

It  is  of  interest  to  note  that  in  their  literature  review,  conducted 
for  the  Air  Force  In  anticipation  of  extended  spaceflight  missions  for  USAF 
personnel,  Naylor  and  Briggs  (1961)  stated  that  the  state  of  information 
was  not  only  deplorable  academically,  but  . . it  is  rapidly  becoming 

intolerable  from  a practical  point  of  view."  In  spite  of  the  deficiencies 
of  the  literature,  Naylor  and  Briggs  were  able  to  provide  a milestone  sum- 
mary that  is  stili  useful.  Because  of  the  diversity  of  the  more  general 
literature  covered  in  their  review  and  its  general  lack  of  pertinence  to 
flight  tasks,  it  was  necessary  that  they  develop  a Schema  that  would  allow 
relating  the  literature  to  flying.  To  this  end,  they  classified  the  liter- 
ature on  the  basis  of  four  types  of  variables:  (1)  task  variables;  (2) 

learning  variables;  (3)  retention  interval  variables;  and  (4)  recall  vari- 
ables. Brief  discussions  of  their  major  conclusions  in  each  of  these  areas 
fo 1 low. 

Task  Variables.  Naylor  and  Briggs  conclude  that  the  literature  does 
not  support  the  contention  that  motor  tasks  are  better  retained  than  verbal 
tasks,  though  they  do  note  that  continuous  control  tasks  show  superior  re- 
tention to  discrete  proeedural  tasks.  This  finding,  they  feel,  is  more  a 
reflection  of  the  greater  retentivity  of  tasks  that  have  a higher  internal 
logical  structure  (task  integration). 

Learning  Variables.  Their  principal  conclusion  of  interest  here  is 
that  the  higher  the  level  of  original  learning,  the  higher  is  the  amount 
retained  Also  of  interest  is  their  observation  that,  while  distributed 
practice  during  original  learning  may  result  in  faster  skill  acquisition, 
it  does  not  seem  to  affect  retention. 

Retention  Interval  Variables.  Naylor  and  Briggs  cite  length  of  the 
retention  interval  (i.e.,  the  no-practice  period)  as  a powerful  factor  in 
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retention,  albeit  one  that  may  act  through  operant  mechanisms  other  than 
time  per  se,  for  example,  habit  interference.  They  do  not  feel  that  there 
is  a single  decrement  function  curve,  but  rather  that  decrement  is  specific 
to  the  task  and  situation.  The  beneficial  effects  of  rehearsal  during  the 
retention  interval  are  noted,  with  the  effect  increasing  as  the  similarity 
of  the  rehearsal  task  to  the  recall  or  criterion  task  increases. 

Recall  Variables.  The  major  conclusions  in  this  area  of  current 
concern  relate  to  the  positive  influence  of  iicreasing  similarity  between 
recall  task  and  original  task,  and  the  beneficial  effects  of  warm-up 
activity.  A conclusion  ot  considerable  methodological  Import  is  their 
observation  t'<at  amount  of  retention,  as  measured  experimentally,  is  a 
function  of  the  type  of  recall  measure  used.  This  point  has  practical, 
or  applied,  import  as  well  as  theoretical,  since  the  individual  attempting 
to  use  research  data  in  real-world  situations  must  be  aware  of  measurement 
influences. 

Naylor  and  Briggs  recognized  clearly  the  inadequate  state  of  infor- 
mation and  the  need  for  programmatic  research  on  long-term  retention  of 
skills.  They  called  for  new  research  on  two  points  in  particular,  task 
organization  and  measurement  methodology. 

Gardl i n and  Sltterley  Review 

The  other  major  review  of  interest  here  is  that  of  Gardlin  and  Sitter- 
ley  (1972).  In  reviewing  the  literature  of  the  1960s,  they  note  that  popu- 
lar areas  of  investigation  included  type  and  amount  of  training,  task  or- 
ganisation, equipment  parameters,  rehear?*’  and  secondary  cask  interfer- 
ence. The  authoi  s organize  the  resu",  i of  their  literature  review  under 
four  headings:  (1)  amount  of  training;  (2)  duration  of  retention  interval; 

(3)  tajk  organization;  and  (4)  task  environment. 
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Amount  of  Training.  Gardlin  and  Sitterley  conclude  from  their  review 
that  amount  of  training  is  positively  and  influentially  related  to  amount 
retained.  However,  they  note  that  absolute  loss  in  performance  for  any 
given  task-retention  interval  combination  is  not  differentially  affected 
by  amount  of  training.  They  state  that  ",  . . it  may  be  concluded  that 
the  type  of  training  which  produces  the  highest  level  of  performance  will 
also  produce  the  best  retention  test  performance." 

Duration  of  retention  Interval.  In  reviewing  this  area,  they  note 
that,  "unsurprisingly ,"  longer  retention  intervals  produce  greater  skill 
loss  and  lower  initial  retention  test  performance.  They  highlight  a 
point  of  considerable  concern  to  those  attempting  to  apply  research  data 
on  retention,  i.e.,  that  retention  data  are  highly  specific  to  the  task 
and  situation  studied.  They  note,  for  example,  that  results  using  a two- 
year  retention  interval  have  varied  from  the  "no  noticeable  decrement"  of 
Fleishman  and  Parker  (1962)  to  the  significant  decrements  observed  by  Ammons 
et  al  (1958).  Of  interest,  too,  is  Gardlin  and  Sitterley's  observation  that 
while  both  tracking  and  procedural  skills  show  increasing  decrements  as 
retention  interval  increases,  and  while  both  types  of  skills  can  be  restored 
(retrained)  to  original  levels  in  considerably  less  time  than  required  for 
original  learning,  the  time  required  to  retrain  procedural  skills  is  rela- 
tively much  greater  than  that  for  tracking  skills.  With  reference  to  proce- 
dural tasks,  they  note  that  commissive  errors  are  most  affected  by  time  in- 
terval. They  also  note  that  practice  and  warm-up  are  beneficial  to  perform- 
ance regardless  of  time  interval. 

Task  Organization.  Effects  of  task  organization  were  noted  to  be 
contingent  on  degree  of  original  training  with  retention  of  lesser  trained 
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subjects  being  higher  for  tasks  with  high  organization.  Thus,  the 
authors  state,  . . th*  key  factor  in  predicting  skill  retention  for 
a given  no-practice  interval  appears  to  be  the  final  level  of  skill 
acquisition.  O'-lier  variables  were  seen  only  to  modify  this  level." 

Task  Environment.  Factors  studied  in  this  area  of  their  review 
included  display-control  relationships,  degree  of  fidelity  in  training 
devices,  display  specificity,  augmented  feedback,  and  visual  noise. 

Gardlin  and  Sitterlev  indicate  that  equipment  factors  are  important  to 
retention,  principally,  as  they  affect  the  level  of  skill  achieved  in 
original  learning,  and  in  similarity  of  retention  task  environment  to 
original  task  environment. 

In  discussing  the  results  of  their  review,  Gardlin  and  Sitterley 
conclude  that  level  of  performance  prior  to  the  retention  interval  is 
the  primary  predictor  of  retention  for  any  retention  interval.  They  note 
that  there  haa  been  .ittle  attention  devoted  to  the  characteristics  of 
those  individuals  who  achieve  high  levels  of  performance.  Research  in 
this  area  would  be  desirable,  they  state,  as  would  research  related  to 
temporal  skills  and  to  performance  measurement.  Additional  research  needs 
cited  include  the  effects  of  environmental  and  psychological  stress  on 
retention  and  establishment  of  relationships  between  the  simplified  labo- 
ratory tasks  used  in  most  retention  studies  and  the  real-world  tasks  in 
which  the  applied  researcher  is  interested.  It  is  lack  of  relationship 
data,  they  point  out,  that  makes  it  difficult  to  use  the  research  data  to 
predict  retention  In  specific  situations. 

Othe  r Literature  Rev  lews 

Other  researchers  have  conducted  reviews  of  the  skills  retention 
literature,  but  generally  of  a more  restricted  scope  than  those  discussed. 
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Wright  (1969)  reviewed  the  behavioral  science  literature  (76  references) 
as  it  pertained  to  Army  proficiency  flying  programs.  His  review  has  not 
been  widely  available  to  the  research  audience,  but  it  served  as  background 
to  his  subsequent  study  (Wright  (1973))  of  retention  of  flying  skills  and 
retraining  requirements  among  Army  aviators.  His  conclusions  in  hie  re- 
view (1969)  concerning  retention  included  the  following:  (1)  flight  skills 

are  retained  well  for  periods  up  to  two  years,  and  retraining  is  rapid; 

(2)  procedural  skills  lacking  Internal  organization  are  rapidly  forgotten; 

(3)  the  greater  the  amount  of  original  learning,  the  greater  the  retention; 

(4)  forgetting  curves  for  flight  skills  show  negative  acceleration;  (5) 
retention  is  a function  of  task  organization;  (6)  mental  rehearsal  facili- 
tates performance;  (7)  degree  of  activity  in  rehearsal  is  positively  re- 
lated to  degree  of  recall;  and  (8)  initial  retention  performance  is  affected 
by  the  similarity  of  both  the  original  learning  task  and  interpolated  tasks 
to  the  retention  task.  Wright  draws  the  „encral  implication  that  the  least- 
cost  option  for  the  Army  would  be  complete  cessation  of  proficiency  flying 
during  non-flying  assignments  followed  by  retraining  specific  to  the  next 
assignment.  He  pushes  for  use  of  training  devices  In  the  maintenance  and 
retraining  of  flight  skills. 

Smith  and  Matheny  (1976)  recently  examined  the  question  of  continuation 
versus  recurrent  pilut  training  as  a means  of  maintaining  required  force 
readiness  among  USAF  raced  supplement  pilots.  They  review  briefly  15  refer- 
ences pertaining  to  proficiency  flying  and  related  matters,  and  they  present 
data  on  USAF  pilot  POW-returnee  retraining.—^  Their  general  conclusions  from 
their  review  are  similar  to  those  of  Wright  (1969).  In  addition,  they 

— ^ The  POW  data  are  discussed  in  the  next  section  of  this  report  dealing 
with  aviat iou-releted  retention  studies. 


conclude  that  I'SAF  pilots  can  be  retrained  in  contact  and  instrument 
flight  skills  In  10  hours  or  less  after  extended  periods  of  non-flying. 

They  recommend  that  existing  continuation  training  for  USAF  rated  supple- 
ment pilots  he  reexamined  to  determine  it  recurrent  training  might  be 
feasible  and  more  cost  effective  than  continuation  training  and  to  deter- 
mine the  most  effective  use  of  ground  training  devices  in  maintaining/ 
regaining  pilot  proficiency. 

The  only  other  major  literature  review  of  direct  concern  to  the  present 
study  is  tiie  exhaustive  review  of  Smode,  Hall,  and  Meyer  (1966).  While 
their  scope  was  far  wider  than  long-term  retention  cf  flying  skills  — 
their  concern  was  research  relevant  to  pilot  training  --  they  devote  one 
section  of  their  review  (pp.  168-176)  to  the  subject,  "Retention  of  Flying 
Skills."  Only  16  references  are  cited  in  that  section,  but  their  obser- 
vations on  .he  research  issued  concerning  retention  are  of  interest.  They 
note  the  need  for  new  approaches,  stating  (p.  175):  "Pesearch  on  retention, 

as  presently  conceived,  has  reached  an  impasse.  The  same  conclusions  con- 
tinue to  be  generated  with  very  little  additional  substance  added."  They 
call  for  programmatic  research  on  f'  ■ carting  fn  terms  of  ti”  acteristics 

of  complex  tasks  and  over  longer  periods  of  time,  and  they  also  note  the 
need  for  a better  understanding  of  and  means  for  measuring  levels  of  learn- 
ing in  flight  tasks.  Unfortunately,  their  advice  has  not  been  well  taken. 
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FLIGHT  SKILL  RETENTION  STUDIES 


Air  University  and  Naval  Postgraduate  School  Studies 

As  has  been  noted,  the  number  of  direct  studies  of  flight  skills 
retention,  particularly  for  relatively  long  time  periods,  ha9  been  fairly 
small.  The  general  subject,  particularly  as  it  relates  to  proficiency 
flying,  has  received  a good  deal  of  attention  in  a variety  of  analytical 
studies  by  USAF  and  USN  students  at  the  Air  University  and  the  Naval  Post- 
graduate School,  respectively  (e.g.,  9ee  Armstrong,  Bleytnaier,  Hinkel, 
Levins,  and  Sheppard  (1975),  Becker  (1965),  Hanley  (1971),  and  Wellington 
(1972)).  And,  in  fact,  while  the  majority  of  such  efforts  have  been  in 
the  nature  of  reviews  of  other  sources,  some  of  these  student  efforts  have 
developed  original  data  of  some  interest.  For  example,  Schrady  and  Hanley 
(1971)  gathered  actual  inflight  proficiency  data  in  making  comparisons  of 
rhe  effects  of  'i-hour  and  8-hour  per  month  CRT  programs.  Their  use  of  a 
semi-objective  checklist  for  measuring  flight  performance  is  notable.  While 
they  found  differences  in  flight  performance  favoring  the  8-hour  per  month 
group,  the  differences  were  not  statistically  significant.  However,  their 
data  tell  us  little  about  retention  after  non-flying  periods.  In  contrast, 
Smittle  (1975)  investigated  reaction  time  to  a simulated  flight  stimulus 
for  Naval  aviators  who  were  current  and  those  who  hod  not  flown  for  60 
days  or  more.  No  significant  difference  was  found.  In  another  student 
effort,  Wilson  (1973)  made  comparisons  of  aviator  performance  of  a simulated 
carrier  landing  task  among  three  groups;  (a)  those  who  were  current;  (b) 
a group  who  had  not  flown  for  about  one  year;  and  (c)  a group  who  had  not 
flown  for  about  two  years.  No  significant  differences  were  found  among 
those  groups,  but  when  the  Ss  were  classified  on  flight  experience,  those 
with  less  than  500  hours  performed  less  well  (p<.10)  than  those  at  higher 
experience  levels. 
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In  another  student  study,  Shaver  (1971)  presents  data  on  Navy  and 
Marine  training  accidents  during  the  first  and  second  1-month  period  of 
Combat  Replacement  Air  Wing  (CRAW)— ^ training  for  aviators  who  had  been 
in  CRT  status  and  those  In  non-CRT  status  during  immediately  prior  non- 
flying  assignments.  Accident  rates  per  10,000  hours  were  0.833  and  1.269 
for  the  CRT  and  non- CRT  jet  pilot  groups,  respectively,  during  the  first 
3-month  period.  During  the  second  3-oon.th  period  the  rates  were  0.620 
and  0.637.  While  these  data  suggest  that  there  may  be  an  increase  In 
accidents  during  retraining  subsequent  to  a non-flying  period,  they  also 
show  that  the  difference  disappears  rapidly.  Alar,  the  author  notea  that 
the  accident  experience  of  the  CRT  group  during  he  period  in  which  they 
were  engaged  in  CRT  flying  should  be  added  to  their  CRAVJ  experience  for  a 
sounder  comparison. 

Data  of  some  direct  interest  in  the  present  context  are  contained  in 
another  student  study,  Tice's  (1973)  A^r  University  examination  of  navi- 
gator proficiency  flying  requirements.  He  cites  data  based  on  training 
performance  at  KC-135  navigator  CCTS  for  31  B-58  Defensive  Systems  Operators 
(DS0)  who  were  being  retrained  as  navigators  after  several  years  as  DSOs. 
Wlille  these  personnel  were  originally  trained  as  navigators,  only  one  had 
ever  flown  operationally  as  a navigator.  Failure  rate  for  the  DSO  group 
in  the  KC-L35  navigator  program  was  6.7%  versus  15%  for  regular  students. 

The  author  concludes  that  navigator  skills  are  retained  quite  well  over 
extended  periods  of  no  practice.  The  commonality  of  skills  required  in 
pilot  and  navigator  jobs  would  suggest  likely  high  retention  of  navigation 
skills  among  pilot  populations.  However,  these  conclusions  must  be  tem- 
pered by  the  fact  that  the  DSOs  were  regularly  engaged  in  flying  missions, 
even  though  in  n non-navigator  role. 

•^CRAW  training  is  analogous  to  USAF  CCTS  training. 
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One  other  student  study,  that  of  Armstrong  et  aj_  (1975)  dealing  with 
the  retraining  of  POWs,  will  be  discussed  In  the  next  section  In  conjunc- 
tion with  the  Smith  and  Matheny  (1976)  treatment  of  the  same  subject.  While 
these  efforts  by  USAF  and  USN  students  were  necessarily  limited  in  their 
data  generating  capabilities,  it  can  be  argued  that  they  represent  the  only 
quasi-exper  Imenta 1 approaches  to  the  long-term  retention  problem  on  the 
part  of  the  Air  force  and  the  Navy  for  more  than  a decade.  The  only  pub- 
lished, officially  sanctioned  and  supported  efforts  by  USAF  and  USN  since 
the  early  1960s  uncovered  in  this  review  are  the  Smith  and  Matheny  (1976) 
review,  the  Saber  Wings  study  (United  States  Air  Force  (1969),  the  Kuse- 
witt  (1968)  examination  of  Navy  CRT  programs,  and  the  Caines  and  Danoff 
(1967)  examination  of  CRT  programs  performed  for  DoD.  Even  adding  the 
study  of  spaceflight  crew  retention  of  Cotte.uan  and  Wood  (1967),  conducted 
by  the  USAF  Aerospace  Medical  Research  Laboratories  jointly  with  NASA,  it 
Is  apparent  that  the  Air  Force  and  Navy  have  not  been  highly  active  in  the 
area  of  direct  studies  of  flight  skill  retention. 

Mi 1 itary /NASA  Retention  Studies 

The  study  of  Mengelkoch,  Adams,  and  Cainer  (1960)  is  the  progenitor 
of  direct  studies  of  retention  of  complex  flying  skills.  Using  a simulator 
for  the  SN.I  aircraft,  they  examined  retention  of  complex  instrument  flying 
skills  over  a A-month  interval.  Their  results  indicated  that,  whereas 
substantial  and  important  decrement  occurred  in  procedural  skills,  the  loss 
of  aircraft  control  skills  was  negligible  over  the  time  period.  They  con- 
cluded that  procedures  retention  is  the  principal  problem  in  flight  skill 
retention,  but  that  a variety  of  training  devices  can  help  alleviate  this 
problem  in  large  measure.  Their  findings  have  been  generally  confirmed  by 
numerous  subsequent  studies  in  a variety  of  contexts. 
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In  a similar  simulator  study,  Hufford  and  Adams  (1961)  investigated 
the  effects  of  whole-  and  part-task  training  in  the  learning  and  relearning 

* 

o'  a complex  homh-toss  maneuver.  Examining  retention  over  a 10-month  in- 
terval, they  found  that  most  flight  control  parameters  (excepting  vertical 
speed  control)  remained  at  acceptable  levels,  while  the  forgetting  of  pro- 
cedures was  virtually  complete.  Also  of  interest  is  their  conclusion  that 
time-sharing  skills  in  complex  tasks  are  subject  to  decrement  over  time 
and  require  whole-task  practice  for  full  reinstatement.  Parker  and  Fleish- 
man (1960)  examined  the  effects  of  amount  and  type  of  training  on  retention 
of  a complex  simulated  radar  intercept  task  over  periods  varying  up  to  24 
months.  They  found  virtually  no  decrement  in  the  complex  perceptual-motor 
control  task  over  the  first  14  months,  and  relatively  little  decrement  even 
at  24  months.  Two  of  their  findings  are  of  particular  interest  to  us.  The 
first  is  their  finding  that  level  of  proficiency  prior  to  the  retention  in- 
} terval  is  closely  related  to  amount  retained  after  the  retention  interval. 

The  second  finding  of  interest  is  the  high  correlation  (r  =.80  - .98)  be- 
tween performance  just  prior  to  and  immediately  after  the  retention  interval. 
While  distributed  practice  showed  some  advantage  over  massed  practice  during 
the  retraining  sessions  after  the  retention  interval,  the  advantage  was  of 
only  short  duration. 

Ammons  et  al  (1958),  in  a very  elaborate  and  well-controlled  study, 
examined  retention  of  procedural  and  compensatory  pursuit  task  skills  over 
periods  of  up  to  two  years.  While  the  tasks  used  were  not  complex,  their 
results  showed  significant  decrement  in  procedural  skills,  even  after  one 
month,  and  relatively  greater  retention  for  tracking  skills.  These  results 
are  consonant  with  the  more  complex  task  studies  previously  described.  Of 
some  significance,  and  confirmed  in  the  results  of  other  investigators,  is 
the  finding  that,  while  level  of  performance  after  the  retention  interval 
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is  directly  a function  of  pre-interval  level  of  training  or  performance 
and  the  length  of  the  retention  interval,  the  absolute  amount  of  skill 
loss  is  a function  of  length  of  retention  interval  and  is  independent  of 
level  of  original  performance  or  training.  A natural  consequence  of  this 
relationship  is  that  relative  skill  loss  for  a given  interval  will  be 
greater  for  the  lesser  trained  groups. 

A generally  consistent  finding  in  flight  skills  retention  research 
has  been  the  finding  that  continuous  control  (tracking)  skills  appear  to 
be  retained  better  than  do  skills  invol'^ng  the  execution  of  discrete 
procedures.  As  previously  noted,  Naylor  and  Briggs  (1961)  in  their  liter- 
ature review  had  concluded  that  the  integrated  nature  or  internal  organi- 
zation that  characterizes  most  perceptual-motor  tasks  probably  is  the 
factor  that  accounts  for  their  seemingly  greater  retentivity  than  that 
shown  by  verbal  or  procedural  tasks.  Accordingly,  Naylor,  Briggs,  and  Reed 
(1962,  1968)  examined  task  organization  as  a variable  in  learning  and 
retention.  Their  study  involved  a three-dimensional  tracking  task  and 
a time-shared  procedural  task.  Results  indicated  that  learning  is  more 
rapid  for  higher  organization  tasks,  but  that  retention  is  primarily  a 
function  of  level  of  original  learning,  not  task  organization,  though  an 
organization  effect  on  retention  was  noted  for  low  levels  of  training.  Thus, 
level  of  original  learning,  which  would  tend  to  be  higher  for  tasks  of 
higher  organization,  is  the  factor  that  underlies  the  apparent  difference 
in  retention  of  control  and  procedural  skills. 

These  results,  as  well  as  those  of  other  investigators,  point  up  the 
importance  of  measurement  methodology  as  it  relates  to  task  difficulty, 
level  of  learning,  and  methods  of  measuring  retention.  For  discussion  of 
these  problems,  the  reader  is  referred  to  Bahrick  (1964,  1966)  and  Bilodeau 
(1966) . The  effect  of  method  of  measurement  on  conclusions  regarding 
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retention  ran  be  seen  in  the  Naylor,  Briggs,  and  rteed  (1962,  1968) 
research.  Tn  measuring  retention  of  procedural  skills  they  used  three 
measures:  (l)  omissive  errors;  (2)  commissive  errors;  and  (3)  response 

time.  Of  these,  only  emissive  error  seemed  sensitive  to  the  retention 
effects  of  the  variables  being  studied  (amount  of  training  and  task 
organization)  . 

The  research  studies  cited  so  far,  except  for  that  of  Mengelkoch  et  aJL 
(1900),  which  involved  more  of  a whole-task  approach,  have  involved  part- 
tasks  or  task  elements  in  simulated  settings.  Another  example  of  the  part- 
task  type  of  effort  is  the  study  of  retention  of  a spaceflight  skill,  i.e. 
skill  in  a visual  image  motion  compensation  task,  performed  by  Youngling, 
Sharpe,  Ricketson,  and  McGee  (1968).  They  examined  effects  on  retention 
of  level  of  training,  task  difficulty,  and  retention  interval  for  periods 
of  30.  90,  and  200  days.  While  this  part-task  is  of  rather  restricted 
nature,  their  findings  were  generally  similar  to  those  of  other  investi- 
gators. They  found  that  level  of  training  affects  level  of  performance 

after  the  retention  interval,  though  there  was  no  effect  on  time  to  re- 

train. Their  findings  on  decrement  as  a function  of  time  differed  slightly 
from  others,  however,  tr.  that  a linear  relationship  existed  between  length 
of  retention  interval  and  amount  retained.  Most  investigators  have  leaned 
toward  the  classical  negative iy  accelerated  curve  as  describing  the  reten- 
tion and  forgetting  functions.  Another  variance  was  their  finding  that  the 

more  difficult  task  conditions  resulted  in  better  retention  performance  than 

did  the  less  difficult.  They  attribute  this  seeming  anomaly  to  being  a 
measurement  problem,  stating  "...  (it)  may  easily  be  an  artifact  of  the 
difficulty  level  measurements." 
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Several  effort;  have  examined  retention  in  a whole-task  setting. 

By  far  the  most  elaborate  experiment  on  retention  is  that  of  Cotterman 
and  Wood  (1967).  In  this  study  of  retention  of  spaceflight  skills,  four 
three-man  crews  were  given  five  weeks  of  pre-mission  training  in  the 
simulator  for  the  Apollo  Command  iiodule  and  the  Lunar  Excursion  Module. 
Training  was  then  capped  with  a full  169  hour  simulated  lunar  landing 
mission.  Retention  was  tested  after  4,  3,  9,  and  13  weeks.  While  there 
were  a number  of  factors  that  make  generalization  of  their  results  to 
current  USAF  problems  difficult,  they  found  that  operator  performance  of 
critical  tasks  fell  to  unacceptable  levels  in  8 weeks. 

It  is  clear  from  results  such  as  the  preceding  that  NASA  faces  a 
serious  problem  with  reference  to  skills  retention  for  spaceflight  in- 
volving extended  time  periods  between  original  learning  or  practice  and 
the  later  employment  of  the  skills.  The  effectiveness  of  several  methods 
of  Interim  practice  of  various  spaceflight  skills  was  examined  in  an  ex- 
cellent series  of  studies  by  Sitterley  and  his  associates  (Sitterley  and 
Berge  (1972),  Sitterley,  Zaitzeff,  and  Berge  (1972),  and  Sitterley  (1974)). 
In  one  study,  they  examined  retention  of  spaceflight  skills  involved  in 
a simulated  flight  from  lift-off  to  orbit  insertion,  while  the  other  two 
efforts  examined  retention  of  skills  involved  in  a simulated  descent, 
approach,  and  visual  runway  landing  of  a vehicle  of  the  space  shuttle 
variety.  Retention  periods  of  one  to  six  months  were  used,  and  effects  of 
various  rehearsal  procedures  and  visual  cues  were  examined.  Their  findings 
are  of  considerable  relevance  because  of  the  similarities  of  task  require- 
ments of  the  aerodynamic  type  spacecraft  they  studied  and  those  of  current 
and  future^USAF  aircraft.  Degradation  of  control  skills  was  moderate  for 
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the  first  three  months,  hut  then  increased  sharply.  After  that  point, 
magnitude  of  control  errors  exceeded  end-of-tra ining  levels  by  a factor 
of  two  to  three.  In  contrast,  procedural  tasks  showed  strong  degradation 
after  only  one  month.  Time  to  execute  procedures  was  five  times  as  great 
as  end-uf-training  value  after  only  one  month,  and  17  times  as  great  after 
four  months.  Instrument  flight  skills  were  found  to  degrade  more  rapidly 
than  those  involving  far-field  visual  cues,  a finding  that  is  in  agreement 
with  that  of  Wright  (1973)  for  a military  pilot  population.  Sitterley  et  al 
found  that  both  procedural  and  control  skills  could  be  maintained  at  ac- 
ceptable levels  over  the  time  periods  studied  through  fairly  9imple,  static 
rehearsal  techniques.  This  latter  point  finds  support  in  the  work  of  Prather 
(1973)  on  the  effectiveness  of  "mental  practice,"  and  that  of  Dougherty, 
Houston,  and  Nicklas  (1957),  and  numerous  subsequent  investigators,  con- 
cerning the  efficacy  of  simple  training  devices.  The  work  of  Sitterley 
and  his  associates  is  of  considerable  significance. 

As  has  been  noted,  the  major  official  attention  to  the  skills  reten- 
tion area  by  the  Air  Force  and  the  Navy  in  recent  years,  at  least  indirectly, 
lias  been  in  the  form  of  studies  of  proficiency  flying  programs . The  study 
of  Caines  and  Danoff  (1967),  under  the  sponsorship  of  OASD(SA)  examined 
both  Navy  and  Air  Force  proficiency  programs.  The  objective  was  not  ex- 
amination of  long-term  skills  retention,  but  evaluation  of  proficiency 
levels  of  pilots  who  had  engaged  in  then-current  proficiency  flying  pro- 
grams and  the  development  of  more  effective  proficiency  flying  programs. 

They  examined  CCTS  and  CRAW  training  grades  for  pilots  who  had  been  in 
proficiency  flying  status  just  prior  to  CCTS  or  CRAW.  They  found  that 
pilots  who  had  been  in  proficiency  flying  status  performed  significantly 
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more  poorly  than  those  who  had  been  In  full-time  flying  assignments,  with 
amount  of  decrement  being  a positive  function  of  length  of  proficiency 
flying  period.  Decrement  was  greatest  for  tasks  involving  high  information 
volume  and  rate  with  simultaneous  motor  control  task  requirements.  They 
concluded  that  proficiency  flying  programs  were  in  need  of  improvement. 

Kusewitt  ( 1 9 fa 8 ) conducted  a similar  study  of  Navy  CRT  programs  for 
the  DCNO  vAir).  A variety  of  data  sources  were  utilized,  including  a 
survey  of  1.600  Nival  aviators  and  324  Naval  flight  officers.  Detailed 
results  will  not  be  discussed  here  since  the  study  was  classified,  but 
certain  of  the  unclassified  findings  can  be  mentioned.  This  study,  too, 
concluded  that  the  CRT  program  needed  improvement,  but  it  was  felt  that 
the  benefits  to  cost  ratio  was  still  3 or  4 to  1.  In  examining  the  effects 
of  type  of  aircraft  used  in  CRT,  they  concluded  that  savings  in  the  re- 
training of  aviators  after  CRT  as  great  as  37  hours  per  aviator  could  be 
realized  if  CRT  and  refresher  training  were  in  the  same  type  of  aircraft. 

As  with  Caines  and  Danoff  (1967),  Kusewitt  (1968)  was  not  concerned  with 
long-term  retention  per  se,  but  with  the  evaluation  and  improvement  of 
CRT  programs. 

The  United  States  Air  Force  (1969)  undertook  an  extensive  examination 
of  its  proficiency  flying  programs  in  its  Saber  Wings  study.  This  effort, 
like  the  preceding  one,  was  also  classified,  so  it  will  not  be  discussed 
in  detail.  It  involved  examination  of  existing  data  Buch  as  CCTS  training 
grades,  and  questionnaire  responses  were  secured  from  10,400  USAF  pilots 
concerning  their  experiences  and  views  on  proficiency  flying.  Among  the 
findings  of  interest  was  that  clear  differences  in  CCTS  performance  were 
found  between  those  with  aircraft  flight  backgrounds  similar  to  the  CCTS 
aircraft  (i.e.  fighter  to  fighter)  and  those  with  dissimilar  backgrounds. 
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A1  so,  pilots  in  F-4  COTS  who  had  operational  background  in  other  than 
fighter  aircraft  exhibited  a decrement  in  their  CCTS  training  performance 
after  age  3".  This  age  difference,  while  still  apparent,  was  not  so  pro- 
nounced for  those  who  had  fighter  background.  These  data  suggest  both 
age  and  experience  as  factors  of  concern  in  advanced  training  or  retraining 
programs.  The  age  effect  noted  for  fighter  CCTS  (i.e.  the  break  at  age  37) 
does  not  appear  until  age  A2  for  pilots  in  C-130  CCTS.  Predictably,  most 
pilots  favored  the  retention  of  proficiency  flying  programs  and  the  use 
of  up-to-date  aircraft  for  proficiency  flying. 

The  Saber  Wings  data  are  of  considerable  interest.  The  suggested 
Importance  of  age,  experience,  and  motivational  factors  should  influence 
future  Air  Force  programs,  though  the  Saber  Wings  data  should  not  be  viewed 
as  definitive.  Controlled  research  investigations  of  these  areas  would 
be  required  for  definitive  answers,  but  there  are  areas  that  must  be  con- 
sidered. Saber  Wings  was  an  important  effort,  but  It  must  be  put  in  con- 
text. As  with  the  Caines  and  Danoff  (1967)  and  Kusewitt  (1968)  studies, 
the  orientation  was  more  to  determine  the  desired  nature  of  proficiency 
flying  programs  rather  than  to  develop  data  on  long-term  retention  of 
flight  skills. 

As  can  be  seen,  the  last  three  studies  described  were  largly  analyti- 
cal and  based  on  analyses  of  existing  training  or  other  data.  They  were 
not  concerned  with  developing  data  directly  on  flight  skill  retention, 
though  the  data  have  certain  implications  ir.  that  regard.  In  view  of  the 
current  problems  faced  by  the  Air  Force,  there  is  need  for  more  research 
concerned  with  the  retraining  of  flying  skills  after  periods  of  non-flyinR 
and  with  non-flying  methods  of  proficiency  maintenance.  The  emphasis  of 
past  research  on  the  nature  of  proficiency  flying  is  less  appropriate  now. 


Unfortunately,  there  is  little  research  that  has  been  accomplished  by  the 
services,  dealing  with  the  retraining  problems.  Two  efforts  are  worthy 
of  mention. 

The  first  is  a series  of  studies  conducted  by  HumRRO  for  the  U.S.  Army. 
The  first  of  these,  by  Wright  (1969),  began  with  an  orientation  similar  to 
the  studies  just  described,  that  of  improving  proficiency  lfying  programs 
within  the  existing  structure.  As  the  effort  developed  into  a data  gather- 
ing phase  (Wright  (1973)),  the  orientation  shifted  toward  evaluating  cur- 
rent programs  for  effectiveness  and  consideration  of  options,  including 
that  of  non-flying  followed  by  refresher  training  before  moving  back  to  a 
cockpit  assignment.  Tn  the  1973  study,  anchored  scale  self-ratings  of 
flight  proficiency  before  and  after  episodes  of  non-flying  or  proficiency 
flying  were  obtained  from  Army  aviators.  Respondents  also  provided  data 
concerning  their  actual  retraining  experiences  prior  to  returning  to  cock- 
pit assignments  after  such  episodes.  Findings  inducated  that  amount  and 
nature  of  skill  decrement  were  very  similar  for  those  who  engaged  in  pro- 
ficiency flying  and  those  who  did  not  fly  at  all;  results  for  both  groups 
indicated  that  basic  visual  flight  skills  remained  generally  acceptable 
for  periods  up  to  36  months,  but  that  Instrument  flight  skills  fell  below 
acceptable  levels  for  about  half  the  pilots  within  17  months.  The  actual 
amount  of  flight  time  received  during  retraining  after  the  episode  was  only 
about  two  hours  less  for  those  who  engaged  in  proficiency  flying  than  for 
those  who  did  not  fly  at  all.  This  stujy  raises  serious  question  about 
the  cost  effectiveness  of  proficiency  flying  programs.  The  author  recom- 
mends use  of  simulators  and  ground  devices  as  a better  approach. 

The  Wright  (1973)  study  suffered  on  two  points.  First,  actual  inflight 
proficiency  measures  were  not  possible;  it  was  necessary  to  use  pilot 
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ratings  that  were  made  at  a point  in  time  subsequent  to  the  episodes  of 
concern.  Second,  there  was  no  control  over  the  retraining  data  In  terms 
of  content  and  method  of  retraining,  levels  of  proficiency  achieved,  and 
other  factors.  Nevertheless,  this  represented  the  first  systematic  effort 
to  gather  data  on  Lho  proficiency  and  retraining  of  a sizable  military  pilot 
population,  and  Wright's  1973  data  present  the  first  detailed  look  at  the 
decrement  function  for  various  components  of  military  pilot  flight  skills. 

The  next  phase  of  this  activity  for  the  Array, (HumRRO  Division  No.  6 
(1974)), was  a small  study  effort  that  involved  th?  gathering  of  detailed 
instrument  flight  performance  data  in  a high-fidelity  helicopter  simulator 
for  three  pilot  groups  of  10  each:  (1)  aviators  in  current  flying  assign- 

ments; (2)  aviators  who  had  been  in  proficiency  flying  status  for  about  a 
year;  and  (3)  aviators  who  had  been  in  a non-flying  status  for  periods  vary- 
ing from  9 to  24  months.  Following  initial  assessment,  each  was  subjected 
to  an  individualized  simulator  retraining  program  designed  to  bring  him 
up  to  the  required  instrument  flight  proficiency  level.  Then,  after  pass- 
ing the  standard  instrument  checkride  in  the  simulator,  each  received  air- 
craft training  required  to  reach  the  same  instrument  flight  criterion  level 
inflight,  and  also  the  training  required  to  pass  a contact  flightcheck. 
Results  showed  that  pilots  currently  in  flying  assignments  required  only 
about  half  a9  much  simulator  training  (6.2  hours  vs.  11.4  and  11.7  hours) 
to  reach  criterion  performance  as  did  the  other  two  groups,  and  that  the 
proficiency  flying  and  no-fly  groups  did  not  differ  from  each  other.  Re- 
quired aircraft  hours  were  very  little  and  similar  for  all  three  groups 
(2.2  to  2.6  instrument  hours;  1.7  to  2.6  contact  hours).  While  this  was  a 
small-scale  study,  these  data  lend  support  to  the  contention  of  several 
other  studies  that  proficiency  flying  programs,  as  they  have  existed,  are 
little  if  any  better  than  non-flying  for  maintenance  of  proriciency  and 
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arc  probable  not  cost  effective.  Further,  the  data  len  ' r.upport  to  the 
idea  that  much  of  the  retraining  or  proficiency  maintenance  requirements 
could  be  effectively  accomplished  in  simulators. 

While  t lie  HumRRO  data  support  the  contention  that  there  is  signifi- 
cant retention  of  flying  skit  Is  over  extended  periods  of  non-flying,  it 
must  be  recognized  that  the  flight  tasks  and  environment  differ  markedly 
between  Army  helicopters  and  USAF  high  performance  aircraft.  The  only 
study  of  retraining  requirements  in  the  USAF  context  is  that  involving  the 
retraining  of  I’OW  returnees  from  Vietnam.  While  their  retraining  was  not 
conducted  as  part  of  a study,  it  was  possible  to  perform  certain  analyses 
of  their  retraining  experiences  after  the  fact.  Data  are  reported  in  two 
sources,  the  study  conducted  at  the  USAF  Air  University  by  Armstrong,  Bley 
maier,  Hinkel,  Levins,  and  Shappard  (1975)  and  in  the  examination  of  con- 
tinuation vs.  recurrent  training  conducted  by  Smith  and  Matheny  (1976)  for 
the  Air  Force  Human  Resources  Laboratory.  While  data  were  potentially 
available  on  about  150  former  POWs , Armstrong  et_  a_l  used  data  on  96  pilots 
all  of  whom  were  retrained  in  the  T-38  aircraft.  Their  interest  was  mere 
oriented  toward  fighter  pilot  questions.  Smith  and  Matheny  compared  data 
for  20  pilots  who  had  been  POW's  for  periods  ranging  t rom  13  to  24  months 
with  that  of  39  pilots  who  had  been  prisoners  for  a more  extended  period, 
69  to  ’02  months.  Results  showed  a relationship  between  length  of  non- 
flying episode  (i.e.  time  as  a POW)  and  amount  of  retraining  time  received 
Armstrong  et_  aj  found  a correlation  of  r = +.334  between  these  factors, 
while  Smith  and  Matheny  report  mean  retraining  flight  times  of  38.4  hours 
for  the  shorter  time  group  and  45.4  hours  lor  the  longer  time  group.  Arm- 
strong et  al  report  a mean  retraining  time  of  45  hours  for  their  subjects 


with  individuals  varying  from  12  to  95  hours.  Total  fighter  time  cor- 
related negatively  (r  = -.237)  with  amount  of  retraining  in  the  Armstrong 
e_t  al  analysis,  while  Smith  and  Natheny  found  a non-linear  relationship 
between  total  flight  experience  and  retraining  time  (M  = 48.5  hours  for 
pilots  with  1,000  or  lower  total  hours;  M = 35.3  hours  for  those  with 
1,001  to  2,000  total  hours;  and  M » 41.6  for  those  with  more  than  2,000 
hours) . 

In  sum,  these  USAF  data  suggest  that  basic  flying  skills  are  sur- 
prisingly well  retained  over  quite  extended  and  most  difficult  non-flying 
episodes.  Retraining  to  acceptable  proficiency  levels,  Smith  and  Matheny 
(1976)  conclude,  could  be  accomplished  in  an  average  of  50  hours  or  less. 
They  conclude  also  that  abolition  of  continuation  training  could  result  in 
significant  cost  savings  for  the  Air  Force  and  should  he  investigated. 
Several  points  should  be  kept  in  mind  with  reference  to  these  date,  however. 
First,  this  was  a highly  opevtal  and  individualized  program.  There  is  no 
assurance  that  the  pilots  were  retrained  to  a common  level  of  proficiency. 

In  fact,  it  is  likely  that  they  were  not,  so  the  retraining  time  measures 
may  be  inappropriate.  Second,  the  retraining  program  was  not  oriented  to 
tactical  skills  In  operational  combat  aircraft.  Also,  it  can  be  argued  that 
this  is  a unique  group  of  personnel  in  terms  of  motivational  factors.  All 
In  all,  however,  it  presents  a convincing  demonstration,  the  most  dramatic 
to  date,  of  the  high  retention  of  flight  skills  over  extremely  long  periods 
of  time  and  of  the  relative  ease  with  which  required  proficiency  can  be 
regained. 

FAA  Retentl on  Studl e s 

The  preceding  constitute  the  most  significant  studies  of  flight  skill 
retention  conducted  in  the  military  context.  There  are  several  efforts 
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of  interest  th.it  were  carried  out  in  non-military  settings.  Two  FAA 
studies  and  two  airline  efforts  of  interest  were  found.  In  addition, 
some  general  observations  by  airline  personnel  ''ill  be  discussed.  The 
FAA  has  been  concerned  with  tiie  extent  to  which  skills  of  private  and 
commercial  pilots  mav  degrade  over  time,  particularly  for  those  who  may 
fly  only  periodically.  Seltzer  (1970)  examined  the  effects  of  time  on 
instrument  flight  skills  (also  see  Seltzer  and  McBrayer  (1971)),  and 
Hollister,  LaPointe,  Oman,  and  Tole  (1973)  examined  factors  related  to 
degradation  of  general  flight  skills.  Both  studies  found  decrements  in 
skill  as  a function  of  time  since  pilot  certification,  but  they  were  not 
really  designed  to  examine  proficiency  retention  as  a function  on  non- 
flying Lime  period.  They  do  confirm  the  importance  of  frequency  and  re- 
cency of  practice  to  pilot  proficiency.  There  were  methodological  problems 
relating  to  the  Seltzer  study  that  make  its  interpretation  difficult,  but 
both  it  and  the  Hollister  et  al^  effort  did  involve  acquisition  of  actual 
inflight  performance  data,  a commendable  feature.  Application  of  these 
data  to  USAF  concern  is  difficult  because  of  the  obvious  differences  in 
pilot  skill  level,  population  characteristics,  and  task  complexity  between 
the  USAF  situation  and  that  of  general  aviation. 

Air line  Retention  Stud  ies 

Two  studies  by  airlines  are  of  interest.  Killian  (1965)  describes 
the  experience  of  United  Airlines  in  upgrading  109  second  officers  to 
pilot  or  first  officer  status.  It  is  not  possible  from  the  data  presented 
in  that  report  to  evaluate  retention  as  a function  of  time  since  function- 
ing as  a pilot,  even  though  the  subjects  had  been  in  second  officer  status 
for  an  average  of  eight  ycirs.  As  such,  they  were,  of  course,  regularly 
engaging  in  flying  activities  as  second  officers,  and  many  were  also  func- 
tioning as  pilots  ir.  military  reserve  units  or  in  other  situations  during 
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their  "non-flying"  period.  However,  no  real  problems  in  upgrading  this 
group  (i.e.  retraining  them  as  pilots)  were  reporter,  and  the  author 
concludes  that  pilot  skills  can  be  retained,  and  even  enhanced  by  means 
other  than  cctual  "stick  and  rudder"  practice.  A more  recent  effort  by 
American  Airlines  (1976)  examined  the  use  of  a modern  simulator  with 
visual  system  for  take-off  and  landing  requalification  training  for  pilots 
who  were  current  in  another  carrier  aircraft,  but  non-current  in  the  type 
being  studied.  No  differences  in  flight  performance  subsequent  to  the 
simulator  training  were  found  as  a function  of  length  of  the  non-currency 
period.  Also,  no  differences  were  found  in  flight  performance  between  the 
simulator  requalified  group  and  a control  group  who  were  requalified  in 
the  usual  manner  with  Inflight  training.  This  effort  sheds  no  specific 
light  on  the  subject  of  skill  retention  after  periods  of  non-flying,  but 
it  does  demonstrate  the  utility  of  the  simulator  in  accomplishing  requali- 
fleacion  training  for  airline  pilots. 

As  has  been  noted  elsewhere  in  this  report,  pare  of  the  present  survey 
effort  involved  query  of  dr  carriers  concerning  their  experience  in  re- 
training pilots  after  non-flying  episodes.  Some  nine  trunk  air  carriers 
were  contacted,  and  replies  were  received  from  six.  In  addition,  replies 
were  received  from  the  Airline  Pilots  Association  and  from  the  Air  Transport 
Association.  The  only  formal  studies  elicited  were  those  described  above. 
However,  the  six  airlines  all  indicate,  generally,  thac  they  have  no  par- 
ticular difficulties  in  retraining  as  pilots  either  second  officers  or 
pilots  just  joining  the  line  who  have  not  flown  for  varying  periods.  Their 
programs  have  in  common  che  virtual  elimination  of  inflight  training  re- 
quirements, except  as  mandatory  under  FAA  regulations,  through  the  use  of 
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modern  simulators,  and  the  practice  of  individualized  training  to  speci- 
fied proficiency  levels  rather  than  to  specific  time  requirements. 

Four  of  tlie  carriers  shared  details  of  the  amounts  of  ground,  simu- 
lator, and  flight  training  they  give  as  a function  of  non-tlying  period 
or  time  since  last  flying  specific  equipment.  While  these  details  are 
proprietary,  they  can  be  summarized  as  follows:  For  pilots  whose  non- 

flying period  is  less  than  one  year,  ground  school  requirements  are  typi- 
cally 1-2  days;  for  those  more  than  one  year  since  flying,  the  ground 
school  ranges  2-9  days.  Simulator  training  range  is  2 - 12  hours  for 
Lhosc  less  than  one  year  non-flying,  and  for  those  more  than  one  year 
ron-flying  the  range  is  4 - 20  hours.  Required  flying  time  varies  from 
merely  the  FAA-requlred  three  take-offs  and  landings  to  perhaps  as  much 
as  two  hours;  proficiency  is  the  determining  factor. 

One  aspect  of  data  supplied  by  one  of  the  airlines  is  of  interest  in 
terms  of  inter-job  transfer  factors,  similar  to  the  DSO  to  navigator  trans- 
ition in  the  Tice  (1973)  study  cited  earlier.  In  transitioning  first- 
officer  pilots  from  one  aircraft  to  another  (e.g.,  from  the  727  to  the  707, 
or  vice  versa),  during  1975-1976  that  carrier  reports  average  ground  school 
time  of  8-12  hours,  and  average  time  in  cockpit  procedures  trainers  (CPT) 
of  35-45  hours.  In  contrast,  in  upgrad 1 ng  second-officer  flight  engineers 
to  first-officer  pilot  status  only  about  3 hours  of  ground  school  and  2-4 
hours  CPT  time  were  required.  However,  average  simulator  time  to  profi- 
ciency was  about  the  same  for  both  the  transition  and  upgrade  groups 
(approximately  15-18  hours),  as  was  flight  time  required  to  reach  profi- 
ciency (1.0  - 2.8  hours).  These  data  can  be  interpreted  as  demonstrating 
the  considerable  positive  transfer  effects  between  the  flight  engineer  and 
pilot  jobs  that  result  in  considerably  reduced  requirements  for  academic 
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and  procedures  training.  Conversely,  the  date  suggest  a possibly  con- 
siderable interference  effect  for  the  transitioning  pilots.  Comparison 
of  the  times  required  to  reach  proficiency  in  the  simulator  and  in  the 
aircraft  with  those  found  in  the  HumRRO  (1974)  study  is  of  some  interest. 
The  times  are  similar,  even  though  the  flight  contexts  and  pilot  popula- 
tions are  quite  different.  In  any  event,  the  airlines  do  not  seem  to  find 
the  retraining  of  pilots  after  extended  non-pilot  episodes  to  be  a sig- 
nificant problem. 
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IV.  DISCUSSION  AND  IMPLICATION 


As  can  he  .seen  from  the  literature  discussed,  the  state  of  knowledge 
concerning  long-term  retention  of  flying  skills  is  not  as  might  be  desired. 
Research  on  the  subject  has  been  sporadic  and  not  well  focused.  Other  than 
the  L'SAF  program  of  the  late  1950s  and  early  1960s,  and  perhaps  the  NASA 
program,  there  has  been  no  concerted,  programmatic  attack  on  the  problem 
that  has  covered  both  its  ba9ic  and  applied  aspects.  Over  the  past  decade, 
the  focus  of  military  research  and  evaluation  programs  in  this  area  has 
been  primarily  on  the  maintenance  of  skills  through  the  mechanism  of  pro- 
ficiency flying.  Consequently,  the  subject  of  flight  skills  retention, 
per  se,  has  received  little  attention. 

In  spite  of  this,  there  are  certain  observations  and  implications 
that  can  be  drawn  from  the  existing  literature  pertinent  to  current  and 
future  USAF  policies  in  management  of  the  rated  force.  While  the  litera- 
ture presented  in  the  preceding  chapter  was  primarily  concerned  with  direct 
studies  of  flight  skills,  it  should  be  noted  that  a good  portion  of  the 
state  of  knowledge  on  skills  retention  derives  from  research  in  non-flight 
settings  and  from  research  involving  abstract  tasks  that  are  representative 
of  the  performatory  dimensions  assumed  to  underly  flight  skills,  such  as 
tracking . 

In  discussing  the  literature,  the  framework  adopted  is  one  aligned 
with  Air  Force  operational  requirements,  rather  than  one  '"hat  is  academic 
or  theoretical.  Accordingly,  three  general  categories  of  discussion  follow: 
(1)  general  retention  factors;  (2)  task  or  skill  factors;  and  (3)  retraining 
factors. 
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GENERAL  RETENTION  FACTORS 


Level  o f Learning 

The  single  most  important  factor  in  determining  absolute  level  of 
performance  after  periods  of  non-practice  has  consistently  been  found  to 
be  level  of  learning,  or  skill,  prior  to  the  non-practice  period.  For 
example,  Naylor  and  Briggs  (1961),  Gardlin  and  Sitterley  (197?),  Ammons 
et  al^  (1958).  Mengelkoch  et^  a_l  (1960),  and  Fleishman  and  Parker  (1962)  all 
stiess  this  factor.  The  implication  is  that  the  higher  the  level  of  per- 
formance prior  to  the  no-practice  interval,  the  higher  it  will  tend  to 
be  afterward.  This  suggests  that  overlearning  may  benefit  retention. 
Unfortunately,  the  question  of  overlearning  effects  has  not  been  investi- 
gated systematically  for  retention  of  complex  skills  such  as  flying.  Many 
of  the  flight-related  studies  have  dealt  with  arbitrarily  established  cri- 
terion levels  that  are  far  below  those  that  characterize  the  professional 
I'SAF  pilot.  The  interest  here  is  with  the  higher  skill  levels  that  char- 
acterize the  third,  or  autonomous,  phase  of  skill  acquisition  discussed  by 
Smode,  Hall,  and  Meyer  (1966).  It  would  appear  likely  that  intra-individual 
variability  in  performance  decreases  progressively  during  this  autonomous 
phase,  but  that  there  are  still  marked  inter-indivioual  differences  in  per- 
formance that  relate  to  differences  in  retention. 

In  contrast,  the  literature  would  suggest  that  the  amount  of  decrement, 
i.e.,  the  absolute  amount  forgotten,  is  largely  independent  of  level  of 
initial  skill  or  training  and  is  much  more  a functisn  of  length  of  the  no- 
practice interval  and  other  factors.  A natural  consequence  of  this  rela- 
tionship is  that  the  relat lve  amount  retained  (i.e.,  post -retent ion  level 
of  performance  relative  to  pre-retention  level)  will  be  related  to  level  of 
original  learning.  To  illustrate,  if  individual  X performs  at  a level  of 
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80  proficiency  units  prior  to  the  no-practice  interval  and  60  after  the 
interval,  he  will  have  lost  20  units,  and  his  relative  retention  can  be 
described  as  75%  (i.e.  60/80  x 100).  In  contrast,  assume  that  individual 
Y,  who  is  less  well  trained,  performs  at  a level  of  60  units  before  the 
no-practice  period.  If  lie  loses  the  same  absolute  amount  36  X,  i.e.,  20 
units,  his  post-interval  performance  level  will  be  40,  and  his  relative 
retention  is  only  67%  (i.e.  40/60  x 100). 

Length  of  Retent  ion  Interva 1 

It  is  difficult  to  make  general  statements  about  the  effects  of  length 
of  retention  interval  that  can  be  applied  in  USAF  force  management  policies. 
The  time  factor  interacts  with  many  other  factors  — e.g.,  type  of  task, 
personal  characteristics,  habit  interference,  etc.  — in  highly  specific 
ways.  With  that  hroad  qualification,  however,  a few  observations  ran  be 
made  with  reference  to  flying  skills.  First,  the  bulk  of  the  laboratory 
studies  (e.g.,  Ammons  et_  aj  (1958),  Melton  (1964),  Hammerton  (1963));  a 
variety  of  simulator  studies  (e.g.,  Mengelkoch  et  aJL  (1960),  Parker  and 
Fleishman  (1960),  Wilson  (1973),  Sitterley  (1974) ); inf light  studies  (Vright 
(1973),  HumRKO  (1974),  Armstrong  £t  al_  (1975),  Smith  and  Matheny  (1976)); 
and  the  reports  of  the  airlines,  all  suggest  that  basic  perceptual-motor 
skills  exhibit  decrement  as  a result  of  non-practice,  but  arc  retained  fairly 
well  for  extended  periods,  and  such  loss  as  does  occur  is  fairly  easily 
reinstated  through  retraining.  As  will  be  noted  in  a subsequent  section, 
there  are  practical  differences  in  retention  as  a function  of  type  of 
skill  involved,  but  it  would  appear  that  retraining  basic  flying  skills 
after  periods  of  no  flying  would  not  be  a major  problem  for  most  military 
pilots . 

No  data  were  found  that  would  allow  depiction,  with  any  degree  of 
confidence,  of  i he  quantitative  relationship  between  time  a'.d  degree  of 
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decrement  for  flight  skflls  characteristic  of  the  USAF  professional  pilot. 
There  seems  to  be  little  question  that  decrement  does  occur  with  no  prac- 
tice and  that,  generally,  the  longer  the  period  of  no  practice,  the  greater 
the  decrement.  The  classical  negatively  accelerated  curve  of  forgetting 
has  typically  been  assumed  by  most  investigators  to  apply  to  flight  skills, 
but  Wright's  (1973)  data  are  perhaps  the  only  empirical  confirmation  of 
tins  for  overall  flight  performance  with  a military  aviator  population.  It 
must  be  kept  in  mind  that  his  data  were  not  based  on  actual  inflight  pro- 
ficiency measures,  but  on  ratings  of  own  proficiency.  His  contentions  that 
skill  degradation  is  rapid  during  the  first  6-12  months  of  no  flying  and 
that  amount  of  decrement  after  the  first  year  is  relatively  slight  receive 
some  support  from  other  research,  but  only  indirectly.  More  daca  are  needed 
on  this  point.  Wright's  data  do  suggest  that,  in  spite  cf  the  decrements 
that  occur,  overall  basic  flight  control  skills  (not  instrument  skills  or 
procedural  skills)  remain  at  relatively  satisfactory  levels  for  extended 
periods . 

Another  means  of  attacking  this  point  is  on  the  basis  of  retraining  re- 
quirements. To  the  extent  that  more  retraining  Is  required  for  longer  non- 
flying episodes,  it  can  be  inferred  that  retention  decreases  with  length 
of  retention  interval.  Unfortunately,  the  data  are  relatively  sparse  in 
this  area  also,  Wright's  (1973)  data  for  actual  mean  training  time  received 
were  reported  as  about  S's,  7,  8,  and  8 hours  for  non-flying  episodes  of  *j> 

1,  2,  and  3 years,  respectively.  Estimates  by  these  same  respondents  of 
time  required  to  resume  pilot-in-command  flying  duties  were  14,  17^,  19 
and  19  hours  for  the  same  length  non-flying  episodes.  The  subsequent  HumRRO 
(1974)  study  found  an  average  total  training  time  to  regain  proficiency 
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(l.o.  simulator  time  plus  aircraft  Instrument  time  plus  aircraft  contact 
time)  of  about  17  hours  for  subjects  who  had  been  in  a non-flying  episode 
of  about  one  year  in  length,  a figure  that  is  consonant  with  Wright's  (1973) 
data.  This  also  comoares  closely  with  the  18*5  average  total  training  time 
for  both  transition  and  upgrade  training  reported  by  the  one  airline  that 
provided  detailed  data.  Unfortunately,  the  non-flying  episode  status  of 
these  airline  subjects  cannot  be  determined.  Finally,  the  two  samples  of 
USAF'  POW  retraining  data  reported  by  Armstrong  et  al_  (1975)  and  Smith  and 
Matheny  (1976)  show  an  average  of  36-38  hours  retraining  for  those  who  were 
POWs  for  an  average  of  about  14  years  and  45-48  hours  for  those  who  were 
detained  for  an  average  of  about  7 years. 

The  retraining  times  of  the  POWs  are  marked  by  extreme  variability. 

For  example,  in  the  Armstrong  et^  al  (1975)  data,  for  a group  of  12  pilots 
whose  POW  period  ranged  from  71  to  80  months,  retraining  time  varied  from 
22.9  to  79.5  hours  (M  * 46.5).  For  their  to.jl  sample,  the  lowest  retrain- 
ing time  was  12.6  hours  for  a pilot  who  was  11  months  as  a POW,  while  the 
highest  retraining  time  was  95  hours  for  an  81  month  POW. 

It  is  likely  that  the  retraining  times  for  the  POW  group  are  inflated 
for  a variety  of  reasons  unrelated  to  proficiency,  such  as  personal  desires, 
building  time  for  aeronautical  designation,  etc.  If  that  be  the  case,  one 
might  hazard  an  estimate,  based  on  all  the  data  s<  s cited,  that  re- 
training of  basic  flying  skills  to  satisfactory  levels  for  USAF  pilots 
could  be  accomplished  in  an  average  time  of  perhaps  25-30  hours  after  one 
year  of  no-flying  and  30-40  hours  after  2-3  years  of  no-flying.  It  must 
be  recognized  that  these  predicted  average  figures  are  based  on  an  inade- 
quate data  base;  that  Individual  factors  such  as  age,  experience,  aptitude, 
motivation,  etc.  might  markedly  influence  the  situation  in  specific  cases; 
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and  that  the  reference  is  to  the  retraining  of  ba9ic  flight  skills  only, 

£t-  not  tactical  flying  skills.  The  general  point,  however,  is  that  the  re- 

training costs  to  restore  basic  flight  proficiency  would  not  seem  excessive, 
even  after  fairly  lengthy  no-flying  periods.  Also,  the  research  previously 
cited  here  concerning  the  use  of  simulators,  as  well  as  the  sizeable  simu- 
lator studies  literature  not  cited,  would  indicate  that  mucn  of  the  basic 
skill  retraining  requirements  could  be  accomplished  with  high  effectiveness 
and  minimum  cost  in  flight  simulators. 

There  is  a discontinuity  in  the  POW  data,  in  terms  of  time  as  POW, 
that  resulted  from  the  cessation  of  activity  over  North  Vietnam  from  mid- 
1968  to  mtd-1971.  This  fact,  as  well  as  the  relatively  small  numbers  in- 
volved at  certain  data  points,  makes  inferences  about  the  shape  of  the 
retention  or  forgetting  curve,  as  indicated  by  retraining  hours,  a rather 
risky  procedure,  but,  the  data  that  exist  would  not  seem  incompatible  with 

! 

the  power  curve  function  cited  by  Wright  (1973).  Whereas  the  Wright  curve 
for  retraining  to  piiot-in-^onanand  level  shows  about  90%  of  the  loss  occur- 
ring in  the  first  year  of  non-flying  and  an  asymptotic  level  of  about  19 
hours  at  18-29  months,  the  POW  data  might  suggest  a slightly  later  approach 
to  asymptote. 

As  has  been  stated  previously,  the  real  area  of  concern  for  the  Air 
Force  is  the  effect  of  various  factors,  including  length  of  retention  inter- 
■ val,  on  the  retention  and  reqequisition  of  those  skills  that  are  critical 

for  the  combat  pilot.  Unfortunately,  no  literature  that  deals  with  the 
decrement  in  combat  skills  as  a function  of  non-flying  time,  at  least  of 
a controlled,  scientific  nature,  were  found.  It  is  reasonable  to  assume 
that  retraining  times  to  che  criterion  of  combat  readiness  will  be  greater 
than  those  cited  for  reacquiring  basrc  aircraft  proficiency;  how  much  greater 
is  not  known.  Tt  can  be  argued,  however,  that  the  evidence  would  suggest 


that  combat  skills  decline  under  typical  proficiency  flying  programs, 
perhaps  as  much  as  under  no-flying  conditions. 

Habit  I nterfel ence  and  Transfer 

The  relationships  that  exist  among  level  of  training,  time,  and  re- 
tention are  complicated  in  specific  instances  by  a variety  of  factors.  One 
important  group  of  such  factors  is  that  relating  to  the  events  and  activi- 
ties that  take  place  during  the  retention  interval.  Forgetting  or  per- 
formance decrement  is  generally  held  to  result  from  habit  or  activity 
interference,  rather  than  the  passage  of  time,  per  se  (e.g.  see  Naylor  and 
Briggs  (1961),  Melton  (1964),  and  Smode,  Beam,  and  Dunlap  (1959)).  Most 
such  interference  would  result  from  activities  during  the  retention  inter- 
val. Adams  (1967)  In  his  book.  Human  Memory,  states: 

"For  all  its  problems,  it  {the  intef rerence  theory}  is  the  best 
theory  of  forgetting  that  we  have,  and  the  evidence  is  almoBt  solely 
derived  from  verbal  behavior  and  recall.  The  significance  of  Inter- 
ference theory  for  nonverbal  response  classes  and  for  recognition  is 
mostly  untested  and  vague.  This  is  a grievous  deficit  because  an 
overriding  issue  for  memory  is  whether  one  set  of  lawful  principles, 
or  more  than  one,  is  required  to  explain  forgetting.  No  strong  reso- 
lution of  this  issue  will  take  place  until  the  laws  cf  forgetting 
are  tried  in  a multitude  of  situations  and  for  a variety  of  response 
classes."  (pp.  305-306.) 

While  the  research  situation,  as  described  in  the  Adams  quotation,  is 
far  from  satisfactory,  some  efforts  have  been  made  to  examine  such  factors. 
The  research  and  evaluation  efforts  on  proficiency  flying,  for  example,  have 
provided  suggestions,  at  least,  concerning  habit  interf e-ence.  A number  of 
the  evaluation  studies,  such  as  Kusewitt  (1968),  Snow  (1965),  and  the  USAF 
(1969)  Saber  Wings  study,  have  suggested  that  type  of  aircraft  flown  during 
proficiency  flying  periods  haB  an  effect  on  skill  retention  and  later  re- 
training performance.  Wright  (1973),  in  fact,  found  that  pilots  who  had 
performed  their  proficiency  flying  in  light  aircraft  during  non-flying 
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assignments,  and  were  then  retrained  in  a more  complex  operational  utility 
aircraft,  received  an  average  of  1.2  hours  more  retraining  instruction  than 
did  pilots  who  had  not  flown  at  all  during  non-flying  assignments.  Kuse- 
witt  (1968)  states  that  refresher  training  savings  as  great  as  37  hours 
per  Naval  aviator  arc  possible  when  proficiency  flying  and  refresher  train- 
ing are  done  in  the  same  model  aircraft. 

Results  such  as  these  can  be  viewed  in  terms  of  habit  interference  or 
in  a care  positive  framework  in  terms  of  transfer  principles.  However, 
results  such  as  the  USAF  (1969)  Saber  Wings  findind  of  substantial  effects 
on  CCTS  training  grades  of  similarity  or  dissimilarity  of  recent  experience 
aircraft  type  with  the  CCTS  aircraft  type,  whether  viewed  in  terms  of  trans- 
fer or  in  terms  of  habit  interference,  are  factors  of  concern.  Further, 
when  the  interaction  of  these  factors  with  ethers  such  as  age  are  considered, 
the  complexity  of  the  force  management  problem  is  compounded. 

Rehearsal Effects 

A more  useful  point  of  view,  perhaps,  relates  to  means  of  minimizing 
decrement  during  periods  of  non-flying  and  of  maximizing  performance  or  re- 
learning after  such  periods.  A variety  of  researchers  have  examined  rehear- 
sal effects  and  distribution  of  practice  as  means  of  minimizing  decrement. 
Their  results  have  generally  shown  rehearsal  to  be  beneficial,  even  when 
involving  fairly  simple  representations  of  task  elements.  ror  example, 
Sitterley's  (1974)  finding  tha..  distributed  rehearsal  of  a static  (i.e. 
non-hands  on)  practice  task  with  static  visual  cues  con’d  sustain  satis- 
factorily for  at  least  six  months  a fairly  complicated  spacecraft  approach 
and  landing  skill  demonstrates  the  power  of  rehearsal.  One  of  the  air 
carriers  contacted  reported  interest  in  using  the  Sitterley  technique  in 
retraining  airline  pilots. 
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The  use  of  training  devices  of  various  sortB  to  maintain  or  retrain 
skills  is  well  established  (e.g.,  see  Mengelkoch,  Adams,  and  Cainer  (1960), 
Adans  and  Hufford  (19621,  HumRRO  (1974))  and  represents  a type  of  rehear- 
sal. Such  devices  vary  in  complexity  and  cost,  so  their  selection  and 
use  should  be  done  in  deliberate  fashion  to  achieve  specific  goals.  Of 
course,  proficiency  flying  itself  can  also  be  viewed  as  an  interim  rehear- 
sal technique,  and  its  productiveness  will  be  subject  to  the  same  general 
rules  that  guide  the  productiveness  of  less  elaborate  techniques.  In  view 
of  the  apparent  effectiveness  of  certain  fairly  simple  rehearsal  techniques, 
and  the  apparent  ineffectiveness  of  many  proficiency  flying  programs,  ques- 
tions arise  as  to  the  reasons  for  this  discrepancy.  The  answer  likely  lies 
in  the  fact  that  the  "simple"  techniques  are  carefully  designed  and  con- 
trolled training  experiences,  targeted  on  critical  task  elements  or  dimen- 
sions. In  contrast,  proficiency  flying  programs  have  typically  not  been 
so  carefully  designed,  controlled,  and  targeted;  their  major  goal  seemingly 
has  been  that  of  simply  putting  the  pilot  in  the  air,  apparently  a result 
not  sufficient  for  maintaining  proficiency  in  operational  tasks. 

TASK/SKILL  FACTORS 

Cont rol  and  Proce dural  Tasks 

The  1:  -rature  suggests  that  there  is  no  fundamental  difference  be- 

tween continuous  control  tasks  and  procedural  tasks,  as  far  as  learning  and 
retention  are  concerned,  if  task  organization  is  taken  into  account.  Des- 
pite this,  in  practice  a variety  of  investigators  have  found  procedural 
tasks  to  exhibit  more  rapid  and  greater  relative  decrement  than  do  contin- 
uous control  tasks.  For  example,  Mengelkoch  et  £1^  (1960)  found  flight  pro- 
cedural skill  decrement  after  only  four  months  that  was  both  statistically 
and  practically  significant.  Hufford  and  Adams  (1961)  found  forgetting  of 
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certain  flight  procedures  to  be  virtually  complete  after  10  months.  Sitter- 
ley  and  hi9  associates  (1972a,  1972b,  1974)  found  sharp  decrement  in  pro- 
cedural skills  after  only  one  month  with  a further  sharp  degradation  after 

three  months.  Sitterlev  and  Berge  (1972)  state: 

"The  results  reflected  a fundamental  difference  in  skill 
degradat ion  between  the  procedure  and  continuous  control  tasks. 

. . . The  magnitude  of  the  degradation  was  clearly  unacceptable 
at  the  shortest  Interval  for  the  procedure  task,  and  at  a level 
which  was  not  found  for  the  continuous  control  task  until  3 months 
without  practice.  At  3 to  4 months,  when  both  tasks  showed  the 
sharply  increased  loss  in  performance,  the  relative  degradation 
magnitude  of  the  procedure  task  was  five  times  greater  than  the 
continuous  control  task."  (p.  65) 

As  stated,  most  researchers  would  agree  that  the  observed  differences 
in  retention  of  procedural  and  control  tasks  are  related  to  the  task  or- 
ganization factor.  However,  a characteristic  of  the  procedural  tasks 
peculiar  to  flying  seems  to  be  their  lack  of  inherent  organization.  Conse- 
quently, they  do  exhinit  marked  and  rapid  decline,  empirically,  a factor 
that  must  be  taken  into  account  in  developing  skill  maintenance  programs. 
Fortunately,  the  research  data  also  indicate  that  procedural  skills  can 
be  maintained  or  retrained  relatively  easily  with  fairly  simple  means.  Their 
integration  with  non-procedural  aspects  of  the  flight  task  in  a time-sharing 
situation  still  requires  some  whole-task  practice,  however, 

In  contrast,  the  literature  on  continuous  control  tasks  indicates  that 
retention  Is  generally  high,  even  for  extended  time  periods.  Such  tasks 
typically  have  a high  degree  of  internal  organization  r.nd  provide  continu- 
ous, immediate,  and  clear-cut  feedback  or  indications  of  response  correct- 
ness to  the  performer.  However,  it  should  be  noted  • hat  much  of  the  data 
available  deals  with  tasks  that  are  considerably  less  complex  than  those 
involved  in  the  operation  of  USAF  combat  aircraft,  and  the  levels  of  train- 
ing or  skill  represented  in  many  of  the  studies  are  much  lower  than  those 
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of  the  professional  USAF  pilot.  Pertinent  to  this  point  are  the  results 
of  Hammerton  (1963)  using  a difficult  second-order  tracking  task.  He  found 
significant  decrement  in  control  skills  after  a six  month  period.  Similarly, 
the  results  of  Sitterley  j5t  a_l  (1972a,  1972b),  using  a complex  spaceflight 
task,  showed  an  increase  in  control  skill  degradation  after  three  months, 
with  control  error  rates  being  2-3  times  as  great  as  at  the  end  of  training. 
These  results  suggest  that  the  "sharp  edge"  of  control  performance  shown 
by  high  skill  pilots  may  decline  fairly  quickly  over  time,  even  though 
basic  control  skills  (which  must  be  considered  highly  overlearned  for  the 
experienced  pilot)  may  remain  relatively  intact  for  extended  periods. 
Instrument  and  Contact  Tasks 

Several  investigators  have  found  a differential  in  decrement  functions 
for  instrument  flight  tasks  and  contact  flight  tasks Both  Wright  (1973) 
and  Sitterley,  Zaitzeff,  and  Berge  (1972)  report  decrements  in  instrument 
skills  of  greater  practical  concern  than  was  the  case  for  visual  flight 
skills.  One  likely  factor  in  the  relatively  greater  degradation  of  instru- 
ment control  skills  is  the  typically  heavy  procedural  task  loading  of  the 
instrument  flight  tasks.  While  Sitterley  et^  al  (1972)  were  expecting  greater 
degradation  for  the  visual  flight  tasks,  their  findings  showed  degradation 
to  be  almost  twice  as  great  for  the  instrument  flight  tasks  as  for  the 
contact  tasks.  They  suggest  this  may  be  due  to  the  relatively  higher  task 
loading  that  characterized  the  instrument  portion  of  their  flights. 
Information  Processing  Tasks 

As  discussed  elsewhere  in  this  report,  one  conception  of  the  pilot's 

-^The  distinction  is  between  those  flight  tasks  or  situations  in  which 
principal  cues  for  the  pilot  are  provided  by  instruments  within  the  cock- 
pit, as  contrasted  with  those  situations  in  which  cues  are  provided,  at 
least  in  part,  by  visual  contact  with  the  extra-cockpit  environment. 
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task,  particularly  at  the  advanced  skill  levels  of  the  combat  pilot,  is 
that  it  is  principally  an  information  processing  task.  Undoubtedly,  there 
is  merit  to  examining  the  pilot’s  job  from  this  point  of  view.  It  may  well 
be  that  i'  is  iis  skill  in  handling  large  volumes  of  complex  information 
rapidly  and  correctly  that  characterizes  the  effective,  skilled  professional 
combat  pilot.  Assuming  that  this  skill  is  largely  acquired  through  che 
long  process  of  training  and  operational  flying  that  characterizes  the 
autonomous  skill  phase  (Smode,  Hall,  and  Meyer  (1966)),  the  question  of 
its  rate  and  amount  of  degradation  during  non-flying  periods  is  of  consid- 
erable interest  to  the  Air  Force.  Unfortunately,  no  literature  dealing 
with  retention  of  this  skill  or  function  has  been  located.  Tools  for  its 
study,  involving  the  concept  of  residual  attention  and  techniques  such  as 
use  of  secondary  tasks,  are  available,  and  such  research  seems  warranted. 
Decision  making  skill  can  be  viewed  in  much  the  same  way  in  terms  of  its 
potential  importance  to  pilot  viability  and  force  management  policies,  but 
lack  of  data,  unfortunately,  prevents  any  meaningful  conclusions  in  this 
area. 

Other  Task  Factors 

There  are  a number  of  other  task  dimensions  or  aspects  of  the  opera- 
tional task  envlrorment  of  potential  concern  to  the  Air  Force,  but  about 
which  little  data  or  firm  conclusions  concerning  retention  exist.  For  ex- 
ample, little  haB  been  published  concerning  retention  of  specific  tactical 
skills  such  as  weapon  employment,  target  acquisition,  and  the  like.  Commu- 
nication skills  ire  critical  to  certain  situations,  but  no  studies  of  their 
retention  were  uncovered. 

An  aspect  that  is  potentially  extremely  important  to  the  area  of  re- 
tention and  force  management  relates  to  performance  under  conditions  of  stress. 
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Relatively  little  is  known  about  the  development  by  the  pilot  of  the 
ability  to  perform  effectively  and  reliably  under  conditions  of  stress, 
particularly  the  stress  of  combat.  While  it  is  probable  that  a portion, 
perhaps  a malor  portion,  of  the  pilot's  stress  tolerance  is  independent 
of  his  flight  training  and  flight  experiences,  it  is  likely  that  it  is 
also  significantly  affected  by  his  flight  experiences.  The  nature  of 
decrement  in  this  ability  to  perform  under  stress  that  might  result  from 
non-flying  episodes  is  not  known.  Nor  are  there  data  concerning  the  re- 
acquisition or  rebuilding  of  this  ability  or  factor  after  a non-flying 
period.  This  is  a significant  area  of  research  need. 

Another  aspect  of  flight  skills  on  which  the  retention  literature  is 
silent  relates  to  the  matter  of  task  and  ability  structure,  as  discussed 
with  reference  to  the  work  of  Hulin  and  Alvares  (1971a,  b,  and  c).  While 
the  theoretical  aspects  of  these  positions  are  beyond  the  scope  of  the 
present  discussion,  it  may  well  be  that  a real  understanding  of  this  as- 
pect of  pilot  skills  and  their  retention  holds  the  key  to  effective  main- 
tenance, retraining,  and  management  of  pilot  skills.  In  less  complex  terms, 
these  factors  may  relate  to  changes  in  control  or  task  performance  strate- 
gies that  take  place  as  a function  of  training  that  allows  certain  per- 
formatory  routines  to  become  fully  or  serai-autonomous.  The  stability  of 
these  higher  level  task  performance  strategies  over  periods  of  non-practice 
and  the  extent  to  which  they  can  be  maintained  or  reinstated  are  not  known. 
RETRAINING  FACTORS 
Use  of  Devices 

It  is  clear  that  a variety  of  procedures  and  techniques  are  available 
for  the  accomplishment  of  flight  skills  retraining  requirements.  There 
would  seem  to  be  little  question  concerning  the  efficacy  of  using  training 
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devices  and  simulators  tor  the  maintenance  and  retraining  of  a variety  of 
flight  skills.  Results  such  as  those  of  HumRRO  (1974)  and  of  the  airlines 
would  indicate  that  all  or  virtually  all  of  the  training  required  to  re- 
instate Kasio  flight  control  and  procedural  skills  can  be  accomplished  in 
modern  flight  simulators.  Kven  for  certain  visual  flight  requirements, 
including  takeoft  and  landing,  the  simulator  has  been  shown  to  be  adequate. 

At  a simpler  level,  the  use  of  a variety  of  part-task  or  lower  fidelity 
devices  has  been  shown  to  be  cost  effective.  Much  can  be  accomplished  in 
the  maintenance  or  retraining  of  many  flight  skills  with  8ucn  devices,  par- 
ticularly in  the  area  of  procedures,  but  the  previous  observation  concerning 
the  criticality  of  targeting  training  objectives  and  controlling  the  train- 
ing situation  should  be  noted. 

It  must  be  recognized,  though,  that  much  less  is  known  aboit  the 
effectiveness  of  simulation  for  the  acquisition,  maintenance,  or  retraining 
of  the  "sharp  edge"  combat  skills.  Current  Air  Force  programs  such  as  the 
SAAC  (Simulator  for  Air-to-Alr  Combat)  will  shed  light  on  this  area.  While 
there  Is  no  reason  to  believe  that  simulation  cannot  make  a substantial  con- 
tribution to  the  development  of  the  higher  order  flight  skills,  much  needs 
to  be  done  to  determine  the  nature  and  extent  of  such  contribution.  How- 
ever, even  while  seeking  the  answe,  to  such  questions,  USAF  force  management 
policies  should  take  advantage  of  the  already  demonstrated  great  potential 
devices  hold  tor  proficiency  maintenance  and  retraining  programs. 

Nature  o f T rain i n£ 

There  are  several  general  conclusions  that  can  be  drawn  from  the 
literature  cited  and  the  general  training  literature  pertinent  to  the  nature 
of  USAF  proficiency  maintenance  or  reinstatement  programs.  As  was  noted  in 
the  section  on  Retention  Factors,  the  required  length  of  retraining  pro- 
grams is  highly  conjectural  on  the  basis  of  what  is  known,  but,  the  litera- 
ture does  clearly  support-  (1)  careful  specification  of  program  objectives; 
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(2)  deliberate  design  of  training  programs  to  accomplish  the  objectives; 

(3)  adequate  methods  of  measurement  and  quality  control;  (4)  use  of  in- 
dividualized, proficiency-paced  training  techniques;  and  (5)  use  of  simu- 
lators and  training  devices  as  cost  effective  means  of  accomplishing 
training  requirements. 

Individual  Factors  in  Retraining 

There  are  many  factors  relating  to  the  characteristics  of  individual 
pilots  or  of  various  sub-populations  of  pilots  that  are  of  potential  con- 
cern to  the  Air  Force  in  its  force  management  policies.  The  concept  of 
the  "unvlable  pilot,"  discussed  earlier,  is  obviously  based  on  the  pre- 
sumption of  such  factors.  Of  course,  manpower  management  policies  can 
quickly  become  unmanageable  and  meaningless  if  they  try  to  take  into  account 
a large  number  of  highly  individualistic  factors.  Understandably,  manage- 
ment policies  are  based  on  factors  of  known  relationship  to  program  ob- 
jectives, factors  that  can  be  easily  identified  (preferably  quantified) 
for  substantial  numbers  of  personnel. 

One  such  factor  that  has  received  some  attention,  thojgh  not  enough, 
is  that  of  pilot  age  and  its  relation  to  performance.  The  psychological 
literature  indicates  that  there  is  a general  decline  in  learning  efficiency 
and  flexibility  that  begins  perhaps  in  the  late  teen  years  and  continues 
on  into  old  age.  in  practice,  this  effect  is  offset  to  varying  degrees 
by  the  accrued  benefits  of  experience.  A number  of  researchers,  for  ex- 
ample, support  the  idea  that  one  can  "learn  how  to  learn"  and  thereby  make 
his  learning  performance  more  efficient  over  time.  Likely,  this  is  an  aspect 
of  the  third  (autonomous)  phase  of  pilot  skill  acquisition.  While  there 
are  obvious  benefits  that  are  concomitant  with  increasing  age  and  exper- 
ience, there  is  general  agreement  that  at  some  point  there  is  a decline 
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in  pilot  ability  to  perform  effectively  under  the  physiological  and  psycho- 
logical stresses  that  characterize  combat  flying. 

Data  to  allow  a more  precise  articulation  of  this  last  contention  are 
sparse,  especially  as  they  relate  to  retention  and  retraining.  The  Saber 
Wings  (JSAF  (1969))  data  suggest  the  existence  of  age-related  differences 
in  training  efficiency  as  a function  of  aircraft  and  task  factors.  An 
example  is  the  finding  that  fighter  CCTS  training  performance  shows  a 
decline  heginning  at  age  37,  but  this  decline  does  not  manifest  itself  until 
age  42  among  those  undergoing  C-130  CCTS.  One  hypothesis  that  might  be 
advanced  to  explain  this  finding  has  to  do  with  the  rate  at  which  things 
happen  in  flight  and  the  complexity  of  the  stimulus  situation.  Stated 
differently,  it  has  to  do  with  information  processing.  Caines  and  Danoff's 
(1967)  observation  that  a major  area  of  deficiency  among  CRT  pilots  was 
that  relating  to  time-shared  tasks  with  high  information  volume  and  rate 
also  is  supportive  of  the  importance  of  the  information  processing  skill. 
From  such  results,  it  would  seem  that  decline  in  this  functional  ability 
and  its  relation  to  specific  flight  ta9k  requirements  should  be  an  area 
of  major  concern  to  L'SAF  management  policies  with  reference  to  proficiency 
maintenance  ard  retraining.  While  the  Saber  Wings  (1969)  data  are  perhaps 
the  best  available  and  do  provide  some  basis  for  policy  development,  a 
better  data  base  is  warranted. 

The  relationship  between  age  and  accident  experience  has  received 
considerable  attention.  However,  as  noted  by  many  researchers  (e.g., 

Zeller  (1962),  Zeller  and  Burke  (1967),  Copp  0971))  the  relationship  is 
not  a simple  one.  The  manner  In  which  skills  retention,  age,  experience 
factors,  and  accident  experience  might  be  used  in  developing  force  manage- 
ment policies  i s complex.  Since  no  one  would  advocate  operational  flying 
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after  extended  layoffs  without  controlled  retraining,  the  problem  for  the 
USAF  is  to  identify  the  underlying  age-related  factors  relevant  to  acci- 
dent experience  (^.g.,  Information  processing,  procedures  skills,  percep- 
tual capabilities)  that  can  he  operant  in  retraining  programs  and  to 
control  them.  Control  might  take  the  form  of  specific  training  prescrip- 
tion or  preventive  procedures,  or  it  might  be  instituted  through  manpower 
management  policies  that  would  exclude  certain  individuals  or  population 
sub-groups  from  entry  into  retraining  programs.  The  present  state  of 
knowledge  is  inadequate  to  this  need,  though. 

Other  types  of  individual  factors  can  be  of  importance.  Studies  such 
as  Kusewitt  (1968),  Saber  Wings  (USAF  (1969)),  and  Wright  (1973)  indicate 
some  of  the  problems  concerning  the  relationship  between  retraining  air- 
craft type  and  aircraft  type  flown  earlier.  While  such  difficulties  can 
be  attributed  in  part  to  habit  interference  and  negative  transfer,  inter- 
pretation of  such  data  is  confounded  by  differences  in  task  difficulty 
peculiar  to  specific  aircraft.  The  general  literature  would  suggest  that 
across-type  transitions  from  more  difficult  to  less  difficult  aircraft  can 
be  accomplished  more  readily  than  in  che  reverse  direction.  This  is  an 
area  of  possible  concern  in  force  management. 

Another  factor  of  considerable  potential  concern  in  the  management  of 
the  rated  force  and  the  unvlable  pilot  relates  to  the  degree  to  whirh  re- 
training and  later  performance  can  be  predicted  for  individuals  or  groups 
of  indivuduals.  The  extremely  high  correlations  found  by  Parker  and  Fleish- 
man (I960)  over  periods  of  up  to  24  months  in  pro-  and  Dost-retent ion  inter- 
val performance  suggest  a stability  of  relative  performance  level  that  could 
be  useful.  While  controlled  data  studies  of  pilot  performance  predictabil- 
ity over  periods  of  non-flying  were  not  found,  the  research  of  Miller  (1974) 
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with  reference’  to  means  of  optimizing  pilot  assignment  and  the  multivariate 

1/  2/ 

performance  predictor  research  of  the  Navy—  and  the  Army—  suggest  the 

possibility  of  effective  moans  of  predicting  post-retention  interval  per- 

1/ 

tormance  . A t hough t -provok  i ng  recent  paper  by  Christ.nl--  suggests  that 
aptitude  tests  may  be  useful  not  only  for  predicting  speed  of  skill  ac- 
quisition in  original  training,  but  in  predicting  rate  of  9kill  decay  and 
rate  of  skill  reacquisition.  If  so,  aptitude  data  could  be  brought  to 
bear,  along  with  a variety  of  other  predictors,  to  identify  those  le98 
likelv  to  benefit  from  retraining  or  less  likely  to  perform  effectively 
after  retraining.  This  is  really  the  crux  of  the  unvlable  pilot  problem. 

If  such  pilots  exist  in  numbers  sufficient  to  be  of  management  concern, 
and  if  they  can  bo  reliably  identified  through  predictor  relationships, 
then  force  management  policies  can  be  formulated  to  maximize  benefits  to 
the  Air  Force.  Care  must  be  taken,  though,  to  insure  that  the  management 
system  is  not  structured  to  make  the  unvlable  pilot  a self-fulfilling 
prophecy . 

A final  area  of  individual  factors  worthy  of  comment  is  the  effect  of 
non-flying  periods  on  pilot  motivation.  Concern  on  tnis  score  is  expressed 
in  the  examination  of  Navy  proficiency  flying  programs  by  Caines  and  Danoff 

* ^Schoenberger , R.W.,  Wherry,  R.J.,  and  Berkshire,  J.R.  Predicting  Success 
in  Aviation  Training.  Research  Report  No.  7,  U.S.  Naval  'school  of  Aviation 
Medicine,  Pensacola , FI.,  1967. 

2/ 

•-  Dees,  J.W.  and  Dufilho,  L.P.  Multivariate  Extrapolation  of  Training 
performance.  HumRRO  Technical  Report  75-16,  Human  Resources  Research 
Organization,  Alexandria,  VA,  1975. 

3/ 

— Christal,  R.E.  What  19  the  Value  of  Aptitude  Tests?  Paper  presented 
at  the  18th  Annual  Conference  of  the  Military  Testing  Association,  Gulf 
Shores,  AL,  19  October  1976. 
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(.1967),  of  Army  programs  in  the  Wright  (1969)  review  study,  and  of  Air 
Force  programs  in  the  USAF  (1969)  Saber  Wings  study.  Certainly,  Dilot 
values  and  motivation  patterns  change  over  time.  It  i9  possible  that  some 
pilots  cannot  tolerate  a hiatus  in  their  flying  experience  and  sustain  the 
degree  of  concentration  and  dedicated  professional  effort  required  of  the 
USAF  profosslru  il  combat  pilot.  Others  may  be  able  to  sustain  their  per- 
formance quite  adequately  after  a non-flying  period.  Existing  data  do 
not  provide  a basis  for  informed  action  on  this  point,  and  research  ex- 
ploration should  bo  undertaken. 
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V.  CONCLUSIONS 


Based  on  Che  preceding  discussions,  several  general  conclusions  can 
be  drawn.  While  ic  is  obvious  that  the  drawing  of  conclusions  from  the 
rather  sparse  behavioral  science  data  that  exist  is  a hazardous  under- 
taking, it  is  equally  obvious  chat  the  Air  Force  must  develop  and  imple- 
ment force  management  policies  and  initiate  programs  regardless  of  the 
state  of  behavioral  science  knowledge  concerning  long-torm  flight  skill 
retention.  It  is  also  clear  that  behavioral  considerations  are  only  one 
of  a number  of  factors  that  policy  makers  must  consider. 

Whereas  past  Air  Force  concern  has  been  largely  with  the  question  of 
how  best  to  maintain  flying  skills  through  proficiency  flying  programs, 
concern  now  must  also  be  with  the  question  of  how  to  retrain  flying  skills 
after  periods  of  non-flying.  Whichever  aspect  is  predominant  in  future 
Air  Force  programs  — skills  maintenance  or  skills  retraining  — the  be- 
havioral science  findings  on  long-term  flight  skills  retention  are  perti- 
nent. In  view  of  the  shift— ^ toward  the  practice  of  no-flying  followed  by 
possible  retraining  that  has  resulted  from  recent  fiscal  and  fuel  resource 
considerations,  conclusions  concerning  the  retraining  of  flight  skills 
after  non-cockpit  /.ssignments  are  of  increaeing  interest. 

The  conclusions  are  presented  under  three  headings:  (1)  those  relating 
to  general  aspects  of  flight  skills  maintenance/retraining  questions;  (2) 
those  relating  to  aspects  of  Air  Force  manpower  management  policies  for 
the  rated  Bupplement;  and  (3)  those  relating  to  research  needs  relevart 
to  the  preceding  categories. 

—^Reports  as  of  this  writing  indicate  that  the  U.S.  Navy  has  abolished 
proficiency  flying  programs  for  Navy  and  Marine  Corps  aviators,  effective 
1 October,  1976. 
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FLIGHT  SKILLS  MAI  NTEN’ANCE/RETRAINING 

1.  Baste  flight  control  skills  are  retained  well  over  extended 
periods  of  non-flying,  and  such  decrement  as  occurs  can  be  remedied  through 
appropriate  retraining  programs.  Principal  areas  of  concern  are  instru- 
ment and  procedures  skills 

2.  The  extent  and  manner  of  degradation  of  tactical  flight  skills 
and  higher  order  flight  skills  over  non-flying  periods  are  largely  un- 
known. While  it  is  likely  that  such  skills  can  he  reinstated  satisfac- 
torily through  retraining  for  most  pilots,  the  cost  and  nature  of  such 
retraining  and  the  proportion  of  Air  Force  pilots  for  whom  such  retrain' 
will  be  cost  effective  are  not  known. 

3.  If  a policy  of  non-flying  followed  by  retraining  is  adopted  for 
some  or  all  Air  Force  rated  supplement  pilots,  there  are  various  actions 
that  can  be  taken  during  the  non-flying  period  to  increase  level  of  skills 
retention  and,  consequently,  to  decrease  retraining  costs.  Such  actions 
can  also  .increase  the  benefits  of  proficiency  flying  programs  if  that 
alternative  is  chosen. 

4.  Both  proficiency  maintenance  and  retraining  programs  should  be 
designed  around  specific  behavioral  objectives.  They  should  be  based  on 
modern  training  technology,  and  the  behavioral  emphasis  should  be  reflected 
In  proficiency  measurement  systems  that  provide  assurance  that  proficiency 
and  force  readiness  goals  have  been  attained. 

5.  Various  training  devices  can  be  used  with  high  cost  effectiveness 
in  flight  skills  maintenance  and  retraining  programs.  These  vary  from 
quite  simple  devices  to  complex  flight  and  weapons  systems  simulators. 
Virtually  all,  if  not  all,  of  transition,  proficiency  maintenance,  and 


74 


retraining  requirements  for  basic  flight  skills  can  be  met  this  way.  While 
such  devices  can  undoubtedly  be  used  to  advantage  with  reference  to  acqui- 
sition, maintenance,  and  retraining  of  tactical  and  higher  order  flight 
skills,  considerably  less  is  known  about  such  use  of  devices  than  is  known 
about  their  use  for  basic  flight  skills. 

6.  The  concept  of  the  "unviable  pilot"  receives  some  support  from  the 
research  literature.  There  are  indications  of  relationships  among  skill 
maintenance,  retention,  retraining,  and  tactical  performance  factors,  on 
the  one  hand,  and  pilot  population  characteristics,  on  the  other,  of  such 
nature  that  the  unviable  pilots  may  be  potentially  identifiable  In  a fashion 
that  will  allow  their  effective  management.  Relevant  population  factors  of 
potential  concern  include  pre-retention  episode  level  of  performance,  age, 
amount  and  type  of  experience,  previous  training  and  operational  perform- 
ance indices,  aptitude  measures,  and  motivational  factors.  While  the  be- 
havioral science  and  statistical  methodologies  exist  that  would  allow  de- 
termination of  the  validity  of  the  unviable  pilot  concept  and  the  feas- 
ibility of  an  operational  system  for  identifying  such  pilots  if  they  exist, 
the  present  state  of  knowledge  of  pilot  characteristics  — i.e.  the  data 
base  --  is  inadequate  for  establ ishment  of  a management  program  Involving 
such  a system. 

MANAGEMENT  OF  THE  RATED  FORCE 

1.  Effective  management  of  the  rated  force  with  reference  to  the 
maintenance  and  retraining  of  flying  skills  requires  behavioral  science 
input.  The  interfacing  between  behavioral  factors  and  manpower  and  force 
management  models  needs  clear  articulation  for  an  effective  behavioral 
science  input.  Force  and  manpower  management  variables  such  as  age,  rank 
structure,  force  makeup,  contingency  plans,  operational  effectiveness 
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requirements,  future  missions  and  equipment,  and  the  like  must  be  speci- 
fied in  terms  of  their  behavioral  requirements  and  implications  if  proper 
behavioral  data  are  to  be  developed  and  inputs  provided  policy  planners 
in  cimely  fashion. 

2.  There  is  need  of  a management  information  system  that  provides 
continuing  feedback  on  the  effectiveness  of  skills  acquisition,  mainten- 
ance, and  retraining  programs.  It  should  provide  information  in  terms 
that  permit  use  in  management  models,  but  a prime  requirement  is  that  such 
indices  be  based  on  sound  methodologies  ..f  pilot  proficiency  measurement 
that  are  relevant  to  both  basic  flying  skill  requirements  and  higher  level 
and  tactical  mission  skill  requirements. 

RESEARCH  NEEDS 

There  are  a number  of  areas  relating  to  flight  skill  retention  in 
which  both  basic  and  applied  research  are  required  to  meet  the  needs  tor 
effective  management  of  the  rated  force.  These  include: 

1.  Nature  of  higher  level  pilot  skills.  The  present  review  reveals 
that  little  research  has  been  done  on  the  nature,  development,  maintenance, 
and  retraining  of  the  higher  level  flight  skills  characteristic  of  the  pro- 
fessional USAK  pilot.  Areas  such  as  ability/skf 1 1 changes  over  time  and 
experience,  information  processing  concepts,  multi-task  residual  attention 
capabilities,  and  learning  and  performatory  strategies  tor  higher  skiii 
levels  appear  as  promising  areas  of  investigation. 

2.  Nature  of  flight  skills  degradation.  Some  data  exist  on  the 
nature  of  decrement  function?  for  basic  pilot  skills.  However,  the  data 
base  needs  expanding  to  cover  more  adequately  the  pilot  populations,  skills, 
and  retention  intervals  of  concern.  Very  little  has  been  dune  concerning 
decrement  functions  for  higher  level  skills  such  as  described  in  paragraph  1. 
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It  is  the  degradation  of  these  higher  level  skills  as  a function  of  time 
and  other  factors  that  Is  most  in  need  of  specification  for  effective 
force  management  programs. 

3 . F actors  in  acquisition  maintenance,  and  retrainl ng  of  higher 
level  pilot  skills.  The  state  of  knowledge  concerning  the  acquisition, 
maintenance,  and  retraining  of  basic  flying  skills  is  generally  adequate 
for  the  development  and  implementation  of  more  cost  effective  programs. 
However,  this  is  not  the  case  with  reference  to  higher  level  pilot  skills. 
Paralleling  the  needs  described  in  paragraphs  1 and  2 is  the  need  for 
development  of  principles  and  understanding  of  effective  training  programs 
for  higher  order  flight  and  tactical  skills.  While  there  is  no  reason  to 
expert  the  principles  underlying  effective  training  to  differ  fundamentally 
for  basic  and  higher  skills,  though  such  might  be  the  case,  until  the  nature 
of  these  higher  skills  is  defined  adequately  and  specific  objectives  for 
their  training  established,  it  will  not  be  possible  to  develop  acquisition, 
maintenance,  and  retraining  programs  of  maximum  effectiveness.  One  par- 
ticular aspect  of  concern  is  the  need  for  advancing  the  technology  of 
design  and  use  of  simulation  for  the  training  of  higher  level  pilot  skills. 
This  implies  attention  to  tactical  gaming  and  engager  -->nt  simulation  tech- 
niques as  well  as  those  techniques  related  to  opt  ration  of  the  aircraft 
and  1 • s vs te;S. 

a.  Uverleainm^  and  higher  leve  1 -Ei  lot  skills.  Tire  literature 
consistently  shows  Ir-vel  of  retention  to  be  related  to  level  of  original 
learning  Tin*  : ntei ac L nni  ul  over  earning  f basic  skills  with  develop- 
ment of  higtei  lev#  ■ pilot  sk  Us  needs  examination,  as  does  the  relation- 
ship . f overlear  ing  - < i 1 1 s»  maintenaice,  etention,  and  retraining.  If 

over learni ne  ot  ertein  performatorv  routines  Is  necessary  to  their  be- 
coming s -mi -a  iti  noinous  in  order  to  allow  the  development  of  higher  skills. 
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the  questions  of  which  skills  warrant  overlearning  (i.e.  repeated  practice), 
how  much  overlearning,  when  in  the  pilot's  career  and  on  what  schedule, 
and  how  to  measure  overlearning  effects  are  of  critical  concern. 

5.  Performance  under  stress.  It  is  clear  that  the  USAF  pilot  must 
be  able  to  oerform  reliably  and  effectively  under  conditions  of  severe 
stress.  The  manner  in  which  this  capability  develops  and  the  extent  to 
which  it  changes  as  a function  of  conditions  such  as  non-flying  or  pro- 
ficiency flying  episodes,  age,  and  career,  experience,  and  personal  factors 
are  not  known.  Because  of  the  criticality  of  the  stress  factor  to  mission 
performance,  force  management  policies  must  be  based  on  sound  knowledge 

in  this  area.  Adequate  mission  performance  requires  more  than  just  the 
requisite  mechanical  skills.  Resistance  to  the  disorgani£ing  effects  of 
stress  must  be  sufficient  to  permit  the  mechanical  skills  to  operate  in 
effective,  integrated  fashion.  Research  is  required  to  this  end. 

6.  Identification  of  the  viable  pilot.  There  are  many  ways  in  which 
pilot  effectiveness  and  viability  may  be  defined.  In  the  present  context, 
the  viable  pilot  .nay  be  described  as  the  pilot  who  can  undergo  a period  of 
non-fiving  or  proficiency  flyirg  and  return  to  cocipit  duties  as  a satis- 
factory performer.  Further,  the  cost  for  skills  maintenance  or  retraining 
must  be  affordable  to  the  Air  Force  in  t> rms  of  benefits  produced  ior  ? i— 
sources  expended.  The  viable  pilot,  then,  retains  ov. ■ such  periods  his 
ability  to  learn,  to  bring  skills  back  to  required  operational  levels  (If, 
in  fact,  his  skills  degrade  In  t:n-  same  way  as  the  less  effective  pilot's), 
and.  most  importantly,  subsequently  to  perform  eftectively  in  the  mis3ion 
environment.  The  opposite  of  the  effective  pilot  i n this  context  is  the 
"unviahle  pilot.''  Tittle  real  data  exist  on  the  characteristics  ot  these 
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two  groups,  if  there  are  two  dtseriminable  groups.  Research  is  needed 
to  determine  if  they  do  exist  and,  if  so,  to  develop  means  for  their 
discrimination.  If  retention  performance  (in  the  sense  described  here) 
can  be  predicted  with  required  accuracies,  a manpower  management  system 
could  be  developed  to  maximize  force  readiness  benefits. 

7.  Measurement . The  research  literature  reveals  little  on  effec- 
tive measurement  techniques  for  higher  level  pilot  skills.  Progress  in 
this  area  is  required  for  adequate  pursuit  of  research  on  retention  of 
higher  pilot  skills  and  for  the  development  of  effective  force  management 
procedures.  One  particular  aspect  is  the  need  for  adequate  definition 

of  and  means  for  measuring  pilot  combat  readiness. 

8.  Pilot  Motivation.  Some  data  exist  relating  to  motivational 
aspects  of  various  programs  of  pilot  skill  management.  Current  data  are 
Inadequate  to  the  needs  of  a sound  manpower  management  program  as  they 
relate  to  the  interaction  of  various  management  alternatives  and  pilot 
career  and  performance  motivation.  Indices  of  the  potential  importance  of 
this  area  to  rated  force  management  are  sufficient  to  warrant  thorough 
investigation  of  lie jc  factors. 

9.  Pre-  and  post-episode  evaluation.  Since  pilots  currently  enter 
and  leave  the  rated  supplement  regularly  and  in  substantial  numbers,  a 
program  should  be  instituted  to  examine  systematically  and  scientifically 
their  pre-  and  post-episode  flight  performance  capabilities.  Such  evalua- 
tions, which  might  be  done  for  all  pilots  concerned  or,  more  likely,  on  a 
sampling  basis  initially,  would  allow  development  of  the  data  base  needed 
to  answer  many  ol  the  questions  posed.  It  need  not  be  a high  cost  program 
and  could  be  a routine  procedural  part  of  encry  to  ana  exit  fcom  the  rated 
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supplement  force.  Obviously,  the  nature  of  such  evaluations  would  re- 


quire careful 
implementable 


thought  and  planning, 
within  a fairly  short 


but  an  evaluation  program  would  be 
time  frame. 
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4.  USAF  Air  University  (Maxwell  AFB,  AL) 

5.  Air  Force  Human  Resources  Laboratory  (FT)  (Williams  AFB,  AZ) 

6.  Air  Force  Office  of  Scientific  Research  (Bolling  AFB,  Washington,  DC) 

7.  Naval  Aeromedical  Research  Institute  (Pensacola  NAS,  FL) 

8.  Naval  Training  Equipment  Center  (Orlando,  FL) 

9.  US  Army  Aeromedical  Research  Laboratory  (Fort  Rucker,  AL) 
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11.  University  of  Illinois  Aviation  Research  Laboratory  (Savoy,  IL) 
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Dr.  Edward  E.  Eddowes 
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Mr.  James  F.  Smith 

3.  Air  Force  Office  of  Scientific  Research 

Dr.  Alfred  R.  Fregly 
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Dr.  Robert  A.  Alkov 

8.  Air  Force  Inspection  and  Safety  Center 

Dr.  Anchard  F.  Zeller 

9.  Naval  Postgraduate  School 

Dr.  Gary  Poock 

10.  Center  for  Prisoner  of  War  Studies,  Naval  Health  Research  Center 

LCDR  Charles  W.  Hutchins 
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Mr.  R.  P.  Terry 
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Dr.  Maud  Tuanderz 
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Dr.  Stanley  Roscoe 
Department  of  Psychology 
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Dr.  Frank  G.  Forrest 

25.  Miami-Dade  Community  College 
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Dr.  Custave  G.  Wenzel 
Department  of  Aviation 
Mr.  Robert  M.  Kane 
Mr.  Neal  P.  Benson,  Jr. 

26.  American  Airlines 

Dr.  Robert  Houston 
Dr.  Dave  Killian 
Mr.  Jack  Mansfield 

27.  Braniff  International  Air  Lines 

Mr.  Marion  S.  Griffith 

28.  Delta  Air  Lines 

Mr.  C.  A.  Smith 

29.  Eastern  Air  Lines 

Mr.  E.P'.  Rordam 
20.  National  Airlines 

Mr.  G.  M.  Watkins 
2l£  Trans  World  Airlines 
Mr.  D.  R.  Alexander 

32.  Air  Line  Pilots  Association,  Research  Department 

Mr.  Michael  E.  Sparrough 

33.  Air  Transport  Association 

Mr.  J.  Roger  Fleming 

34.  Life  Sciences,  Inc. 

Dr.  W.  Guy  Matheny 
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